2023-02-13 17:53:31,954 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor timeout: 13 mins 2023-02-13 17:53:32,236 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b2e1a147-a5e4-cd2d-85aa-2dcb3ac8be25 2023-02-13 17:53:32,252 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-02-13 17:53:32,253 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b2e1a147-a5e4-cd2d-85aa-2dcb3ac8be25/cluster_42c07e65-ff5f-a75e-a69f-8f3d2a010de7, deleteOnExit=true 2023-02-13 17:53:32,253 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-13 17:53:32,254 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b2e1a147-a5e4-cd2d-85aa-2dcb3ac8be25/test.cache.data in system properties and HBase conf 2023-02-13 17:53:32,254 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b2e1a147-a5e4-cd2d-85aa-2dcb3ac8be25/hadoop.tmp.dir in system properties and HBase conf 2023-02-13 17:53:32,255 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b2e1a147-a5e4-cd2d-85aa-2dcb3ac8be25/hadoop.log.dir in system properties and HBase conf 2023-02-13 17:53:32,255 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b2e1a147-a5e4-cd2d-85aa-2dcb3ac8be25/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-13 17:53:32,256 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b2e1a147-a5e4-cd2d-85aa-2dcb3ac8be25/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-13 17:53:32,256 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-13 17:53:32,373 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-02-13 17:53:32,788 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-13 17:53:32,792 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b2e1a147-a5e4-cd2d-85aa-2dcb3ac8be25/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-13 17:53:32,793 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b2e1a147-a5e4-cd2d-85aa-2dcb3ac8be25/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-13 17:53:32,793 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b2e1a147-a5e4-cd2d-85aa-2dcb3ac8be25/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-13 17:53:32,793 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b2e1a147-a5e4-cd2d-85aa-2dcb3ac8be25/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 17:53:32,794 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b2e1a147-a5e4-cd2d-85aa-2dcb3ac8be25/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-13 17:53:32,794 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b2e1a147-a5e4-cd2d-85aa-2dcb3ac8be25/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-13 17:53:32,794 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b2e1a147-a5e4-cd2d-85aa-2dcb3ac8be25/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 17:53:32,795 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b2e1a147-a5e4-cd2d-85aa-2dcb3ac8be25/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 17:53:32,795 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b2e1a147-a5e4-cd2d-85aa-2dcb3ac8be25/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-13 17:53:32,795 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b2e1a147-a5e4-cd2d-85aa-2dcb3ac8be25/nfs.dump.dir in system properties and HBase conf 2023-02-13 17:53:32,796 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b2e1a147-a5e4-cd2d-85aa-2dcb3ac8be25/java.io.tmpdir in system properties and HBase conf 2023-02-13 17:53:32,796 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b2e1a147-a5e4-cd2d-85aa-2dcb3ac8be25/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 17:53:32,796 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b2e1a147-a5e4-cd2d-85aa-2dcb3ac8be25/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-13 17:53:32,797 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b2e1a147-a5e4-cd2d-85aa-2dcb3ac8be25/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-13 17:53:33,383 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 17:53:33,388 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 17:53:33,708 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-13 17:53:33,888 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-02-13 17:53:33,907 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 17:53:33,950 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 17:53:33,982 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b2e1a147-a5e4-cd2d-85aa-2dcb3ac8be25/java.io.tmpdir/Jetty_localhost_43711_hdfs____mvqd0i/webapp 2023-02-13 17:53:34,118 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43711 2023-02-13 17:53:34,134 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 17:53:34,134 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 17:53:34,715 WARN [Listener at localhost/46797] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 17:53:34,799 WARN [Listener at localhost/46797] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 17:53:34,819 WARN [Listener at localhost/46797] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 17:53:34,826 INFO [Listener at localhost/46797] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 17:53:34,830 INFO [Listener at localhost/46797] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b2e1a147-a5e4-cd2d-85aa-2dcb3ac8be25/java.io.tmpdir/Jetty_localhost_44439_datanode____ac9ptt/webapp 2023-02-13 17:53:34,929 INFO [Listener at localhost/46797] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44439 2023-02-13 17:53:35,324 WARN [Listener at localhost/35343] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 17:53:35,860 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd0ad1fec2e5a4de3: Processing first storage report for DS-66b31d51-2df0-4c81-9cca-d2d9d4eb5572 from datanode 2768a823-4a2c-4b8d-8d66-2b14d6ba50bf 2023-02-13 17:53:35,862 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd0ad1fec2e5a4de3: from storage DS-66b31d51-2df0-4c81-9cca-d2d9d4eb5572 node DatanodeRegistration(127.0.0.1:43797, datanodeUuid=2768a823-4a2c-4b8d-8d66-2b14d6ba50bf, infoPort=40833, infoSecurePort=0, ipcPort=35343, storageInfo=lv=-57;cid=testClusterID;nsid=1844673849;c=1676310813462), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-02-13 17:53:35,862 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd0ad1fec2e5a4de3: Processing first storage report for DS-70c92777-03bc-48e4-92e7-fe392e6789d0 from datanode 2768a823-4a2c-4b8d-8d66-2b14d6ba50bf 2023-02-13 17:53:35,862 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd0ad1fec2e5a4de3: from storage DS-70c92777-03bc-48e4-92e7-fe392e6789d0 node DatanodeRegistration(127.0.0.1:43797, datanodeUuid=2768a823-4a2c-4b8d-8d66-2b14d6ba50bf, infoPort=40833, infoSecurePort=0, ipcPort=35343, storageInfo=lv=-57;cid=testClusterID;nsid=1844673849;c=1676310813462), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 17:53:35,901 DEBUG [Listener at localhost/35343] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b2e1a147-a5e4-cd2d-85aa-2dcb3ac8be25 2023-02-13 17:53:35,983 INFO [Listener at localhost/35343] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b2e1a147-a5e4-cd2d-85aa-2dcb3ac8be25/cluster_42c07e65-ff5f-a75e-a69f-8f3d2a010de7/zookeeper_0, clientPort=64825, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b2e1a147-a5e4-cd2d-85aa-2dcb3ac8be25/cluster_42c07e65-ff5f-a75e-a69f-8f3d2a010de7/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b2e1a147-a5e4-cd2d-85aa-2dcb3ac8be25/cluster_42c07e65-ff5f-a75e-a69f-8f3d2a010de7/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-13 17:53:36,001 INFO [Listener at localhost/35343] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=64825 2023-02-13 17:53:36,010 INFO [Listener at localhost/35343] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 17:53:36,012 INFO [Listener at localhost/35343] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 17:53:36,667 INFO [Listener at localhost/35343] util.FSUtils(479): Created version file at hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a with version=8 2023-02-13 17:53:36,667 INFO [Listener at localhost/35343] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/hbase-staging 2023-02-13 17:53:36,982 INFO [Listener at localhost/35343] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-02-13 17:53:37,461 INFO [Listener at localhost/35343] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=3 2023-02-13 17:53:37,496 INFO [Listener at localhost/35343] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 17:53:37,497 INFO [Listener at localhost/35343] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 17:53:37,497 INFO [Listener at localhost/35343] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 17:53:37,497 INFO [Listener at localhost/35343] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 17:53:37,497 INFO [Listener at localhost/35343] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 17:53:37,639 INFO [Listener at localhost/35343] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 17:53:37,723 DEBUG [Listener at localhost/35343] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-02-13 17:53:37,831 INFO [Listener at localhost/35343] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41433 2023-02-13 17:53:37,842 INFO [Listener at localhost/35343] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 17:53:37,844 INFO [Listener at localhost/35343] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 17:53:37,864 INFO [Listener at localhost/35343] zookeeper.RecoverableZooKeeper(93): Process identifier=master:41433 connecting to ZooKeeper ensemble=127.0.0.1:64825 2023-02-13 17:53:37,906 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:414330x0, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 17:53:37,909 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:41433-0x1004ed10ea40000 connected 2023-02-13 17:53:37,938 DEBUG [Listener at localhost/35343] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 17:53:37,939 DEBUG [Listener at localhost/35343] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 17:53:37,943 DEBUG [Listener at localhost/35343] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 17:53:37,954 DEBUG [Listener at localhost/35343] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41433 2023-02-13 17:53:37,955 DEBUG [Listener at localhost/35343] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41433 2023-02-13 17:53:37,955 DEBUG [Listener at localhost/35343] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41433 2023-02-13 17:53:37,955 DEBUG [Listener at localhost/35343] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41433 2023-02-13 17:53:37,956 DEBUG [Listener at localhost/35343] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41433 2023-02-13 17:53:37,963 INFO [Listener at localhost/35343] master.HMaster(439): hbase.rootdir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a, hbase.cluster.distributed=false 2023-02-13 17:53:38,036 INFO [Listener at localhost/35343] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=3 2023-02-13 17:53:38,036 INFO [Listener at localhost/35343] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 17:53:38,036 INFO [Listener at localhost/35343] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 17:53:38,037 INFO [Listener at localhost/35343] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 17:53:38,037 INFO [Listener at localhost/35343] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 17:53:38,037 INFO [Listener at localhost/35343] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 17:53:38,043 INFO [Listener at localhost/35343] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 17:53:38,047 INFO [Listener at localhost/35343] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38881 2023-02-13 17:53:38,049 INFO [Listener at localhost/35343] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 17:53:38,056 DEBUG [Listener at localhost/35343] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 17:53:38,058 INFO [Listener at localhost/35343] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 17:53:38,062 INFO [Listener at localhost/35343] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 17:53:38,064 INFO [Listener at localhost/35343] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38881 connecting to ZooKeeper ensemble=127.0.0.1:64825 2023-02-13 17:53:38,068 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:388810x0, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 17:53:38,069 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:38881-0x1004ed10ea40001 connected 2023-02-13 17:53:38,069 DEBUG [Listener at localhost/35343] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 17:53:38,071 DEBUG [Listener at localhost/35343] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 17:53:38,072 DEBUG [Listener at localhost/35343] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 17:53:38,076 DEBUG [Listener at localhost/35343] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38881 2023-02-13 17:53:38,077 DEBUG [Listener at localhost/35343] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38881 2023-02-13 17:53:38,078 DEBUG [Listener at localhost/35343] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38881 2023-02-13 17:53:38,079 DEBUG [Listener at localhost/35343] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38881 2023-02-13 17:53:38,079 DEBUG [Listener at localhost/35343] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38881 2023-02-13 17:53:38,082 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,41433,1676310816814 2023-02-13 17:53:38,091 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 17:53:38,092 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,41433,1676310816814 2023-02-13 17:53:38,112 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 17:53:38,112 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 17:53:38,113 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 17:53:38,114 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 17:53:38,115 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,41433,1676310816814 from backup master directory 2023-02-13 17:53:38,115 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 17:53:38,120 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,41433,1676310816814 2023-02-13 17:53:38,120 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 17:53:38,121 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 17:53:38,121 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,41433,1676310816814 2023-02-13 17:53:38,125 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-02-13 17:53:38,127 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-02-13 17:53:38,210 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/hbase.id with ID: ef602f03-dd21-43dd-9aac-86cfc5359bce 2023-02-13 17:53:38,252 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 17:53:38,267 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 17:53:38,305 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x6d5aa146 to 127.0.0.1:64825 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 17:53:38,339 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@76b7d516, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 17:53:38,363 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 17:53:38,365 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-13 17:53:38,382 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-02-13 17:53:38,382 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-02-13 17:53:38,384 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-13 17:53:38,388 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-13 17:53:38,389 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 17:53:38,424 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/MasterData/data/master/store-tmp 2023-02-13 17:53:38,450 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 17:53:38,450 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 17:53:38,451 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 17:53:38,451 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 17:53:38,451 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 17:53:38,451 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 17:53:38,451 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 17:53:38,451 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676310818450Disabling compacts and flushes for region at 1676310818450Disabling writes for close at 1676310818451 (+1 ms)Writing region close event to WAL at 1676310818451Closed at 1676310818451 2023-02-13 17:53:38,453 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/MasterData/WALs/jenkins-hbase4.apache.org,41433,1676310816814 2023-02-13 17:53:38,476 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41433%2C1676310816814, suffix=, logDir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/MasterData/WALs/jenkins-hbase4.apache.org,41433,1676310816814, archiveDir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/MasterData/oldWALs, maxLogs=10 2023-02-13 17:53:38,538 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43797,DS-66b31d51-2df0-4c81-9cca-d2d9d4eb5572,DISK] 2023-02-13 17:53:38,547 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-02-13 17:53:38,622 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/MasterData/WALs/jenkins-hbase4.apache.org,41433,1676310816814/jenkins-hbase4.apache.org%2C41433%2C1676310816814.1676310818487 2023-02-13 17:53:38,623 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43797,DS-66b31d51-2df0-4c81-9cca-d2d9d4eb5572,DISK]] 2023-02-13 17:53:38,623 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-13 17:53:38,624 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 17:53:38,628 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 17:53:38,630 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 17:53:38,700 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-13 17:53:38,707 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-13 17:53:38,737 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-13 17:53:38,751 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 17:53:38,757 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 17:53:38,759 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 17:53:38,775 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 17:53:38,781 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 17:53:38,782 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68079226, jitterRate=0.0144595205783844}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 17:53:38,782 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676310818667Initializing all the Stores at 1676310818670 (+3 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676310818670Cleaning up temporary data from old regions at 1676310818766 (+96 ms)Cleaning up detritus from prior splits at 1676310818767 (+1 ms)Region opened successfully at 1676310818782 (+15 ms) 2023-02-13 17:53:38,783 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-13 17:53:38,804 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-13 17:53:38,804 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-13 17:53:38,807 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-13 17:53:38,809 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-02-13 17:53:38,845 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 35 msec 2023-02-13 17:53:38,845 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-13 17:53:38,871 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-13 17:53:38,877 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-13 17:53:38,907 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-13 17:53:38,912 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-13 17:53:38,915 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-13 17:53:38,921 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-13 17:53:38,925 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-13 17:53:38,928 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 17:53:38,929 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-13 17:53:38,930 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-13 17:53:38,941 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-13 17:53:38,946 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 17:53:38,946 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 17:53:38,946 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 17:53:38,946 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,41433,1676310816814, sessionid=0x1004ed10ea40000, setting cluster-up flag (Was=false) 2023-02-13 17:53:38,962 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 17:53:38,968 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-13 17:53:38,970 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41433,1676310816814 2023-02-13 17:53:38,975 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 17:53:38,981 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-13 17:53:38,983 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41433,1676310816814 2023-02-13 17:53:38,986 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.hbase-snapshot/.tmp 2023-02-13 17:53:39,086 INFO [RS:0;jenkins-hbase4:38881] regionserver.HRegionServer(952): ClusterId : ef602f03-dd21-43dd-9aac-86cfc5359bce 2023-02-13 17:53:39,091 DEBUG [RS:0;jenkins-hbase4:38881] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 17:53:39,096 DEBUG [RS:0;jenkins-hbase4:38881] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 17:53:39,096 DEBUG [RS:0;jenkins-hbase4:38881] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 17:53:39,099 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-13 17:53:39,100 DEBUG [RS:0;jenkins-hbase4:38881] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 17:53:39,101 DEBUG [RS:0;jenkins-hbase4:38881] zookeeper.ReadOnlyZKClient(139): Connect 0x07d5cf0e to 127.0.0.1:64825 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 17:53:39,116 DEBUG [RS:0;jenkins-hbase4:38881] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@9123184, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 17:53:39,117 DEBUG [RS:0;jenkins-hbase4:38881] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d2da47e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 17:53:39,119 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 17:53:39,119 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 17:53:39,119 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 17:53:39,119 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 17:53:39,119 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-13 17:53:39,119 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 17:53:39,120 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 17:53:39,120 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 17:53:39,130 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676310849130 2023-02-13 17:53:39,133 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-13 17:53:39,138 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 17:53:39,139 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-13 17:53:39,145 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 17:53:39,146 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-13 17:53:39,148 DEBUG [RS:0;jenkins-hbase4:38881] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:38881 2023-02-13 17:53:39,159 INFO [RS:0;jenkins-hbase4:38881] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 17:53:39,160 INFO [RS:0;jenkins-hbase4:38881] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 17:53:39,160 DEBUG [RS:0;jenkins-hbase4:38881] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 17:53:39,162 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-13 17:53:39,162 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-13 17:53:39,163 INFO [RS:0;jenkins-hbase4:38881] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,41433,1676310816814 with isa=jenkins-hbase4.apache.org/172.31.14.131:38881, startcode=1676310818035 2023-02-13 17:53:39,164 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-13 17:53:39,164 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-13 17:53:39,166 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 17:53:39,174 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-13 17:53:39,177 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-13 17:53:39,177 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-13 17:53:39,185 DEBUG [RS:0;jenkins-hbase4:38881] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 17:53:39,188 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-13 17:53:39,188 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-13 17:53:39,196 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676310819192,5,FailOnTimeoutGroup] 2023-02-13 17:53:39,196 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676310819196,5,FailOnTimeoutGroup] 2023-02-13 17:53:39,197 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 17:53:39,198 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-13 17:53:39,200 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-13 17:53:39,200 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-13 17:53:39,246 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60553, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 17:53:39,259 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:39,275 DEBUG [RS:0;jenkins-hbase4:38881] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a 2023-02-13 17:53:39,275 DEBUG [RS:0;jenkins-hbase4:38881] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:46797 2023-02-13 17:53:39,275 DEBUG [RS:0;jenkins-hbase4:38881] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 17:53:39,281 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 17:53:39,281 DEBUG [RS:0;jenkins-hbase4:38881] zookeeper.ZKUtil(162): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:39,282 WARN [RS:0;jenkins-hbase4:38881] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 17:53:39,282 INFO [RS:0;jenkins-hbase4:38881] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 17:53:39,283 DEBUG [RS:0;jenkins-hbase4:38881] regionserver.HRegionServer(1947): logDir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/WALs/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:39,284 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38881,1676310818035] 2023-02-13 17:53:39,296 DEBUG [RS:0;jenkins-hbase4:38881] zookeeper.ZKUtil(162): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:39,309 DEBUG [RS:0;jenkins-hbase4:38881] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 17:53:39,317 INFO [RS:0;jenkins-hbase4:38881] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 17:53:39,339 INFO [RS:0;jenkins-hbase4:38881] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 17:53:39,344 INFO [RS:0;jenkins-hbase4:38881] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 17:53:39,344 INFO [RS:0;jenkins-hbase4:38881] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 17:53:39,347 INFO [RS:0;jenkins-hbase4:38881] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 17:53:39,356 INFO [RS:0;jenkins-hbase4:38881] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=100, unit=MILLISECONDS is enabled. 2023-02-13 17:53:39,357 DEBUG [RS:0;jenkins-hbase4:38881] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 17:53:39,357 DEBUG [RS:0;jenkins-hbase4:38881] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 17:53:39,357 DEBUG [RS:0;jenkins-hbase4:38881] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 17:53:39,358 DEBUG [RS:0;jenkins-hbase4:38881] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 17:53:39,358 DEBUG [RS:0;jenkins-hbase4:38881] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 17:53:39,358 DEBUG [RS:0;jenkins-hbase4:38881] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 17:53:39,358 DEBUG [RS:0;jenkins-hbase4:38881] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 17:53:39,359 DEBUG [RS:0;jenkins-hbase4:38881] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 17:53:39,359 DEBUG [RS:0;jenkins-hbase4:38881] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 17:53:39,359 DEBUG [RS:0;jenkins-hbase4:38881] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 17:53:39,360 INFO [RS:0;jenkins-hbase4:38881] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 17:53:39,360 INFO [RS:0;jenkins-hbase4:38881] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 17:53:39,360 INFO [RS:0;jenkins-hbase4:38881] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 17:53:39,376 INFO [RS:0;jenkins-hbase4:38881] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 17:53:39,378 INFO [RS:0;jenkins-hbase4:38881] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38881,1676310818035-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 17:53:39,394 INFO [RS:0;jenkins-hbase4:38881] regionserver.Replication(203): jenkins-hbase4.apache.org,38881,1676310818035 started 2023-02-13 17:53:39,394 INFO [RS:0;jenkins-hbase4:38881] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,38881,1676310818035, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38881, sessionid=0x1004ed10ea40001 2023-02-13 17:53:39,394 DEBUG [RS:0;jenkins-hbase4:38881] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 17:53:39,394 DEBUG [RS:0;jenkins-hbase4:38881] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:39,394 DEBUG [RS:0;jenkins-hbase4:38881] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38881,1676310818035' 2023-02-13 17:53:39,394 DEBUG [RS:0;jenkins-hbase4:38881] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:53:39,395 DEBUG [RS:0;jenkins-hbase4:38881] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:53:39,395 DEBUG [RS:0;jenkins-hbase4:38881] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 17:53:39,395 DEBUG [RS:0;jenkins-hbase4:38881] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 17:53:39,396 DEBUG [RS:0;jenkins-hbase4:38881] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:39,396 DEBUG [RS:0;jenkins-hbase4:38881] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38881,1676310818035' 2023-02-13 17:53:39,396 DEBUG [RS:0;jenkins-hbase4:38881] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 17:53:39,396 DEBUG [RS:0;jenkins-hbase4:38881] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 17:53:39,397 DEBUG [RS:0;jenkins-hbase4:38881] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 17:53:39,397 INFO [RS:0;jenkins-hbase4:38881] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 17:53:39,397 INFO [RS:0;jenkins-hbase4:38881] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 17:53:39,511 INFO [RS:0;jenkins-hbase4:38881] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38881%2C1676310818035, suffix=, logDir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/WALs/jenkins-hbase4.apache.org,38881,1676310818035, archiveDir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/oldWALs, maxLogs=32 2023-02-13 17:53:39,529 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43797,DS-66b31d51-2df0-4c81-9cca-d2d9d4eb5572,DISK] 2023-02-13 17:53:39,533 INFO [RS:0;jenkins-hbase4:38881] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/WALs/jenkins-hbase4.apache.org,38881,1676310818035/jenkins-hbase4.apache.org%2C38881%2C1676310818035.1676310819513 2023-02-13 17:53:39,534 DEBUG [RS:0;jenkins-hbase4:38881] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43797,DS-66b31d51-2df0-4c81-9cca-d2d9d4eb5572,DISK]] 2023-02-13 17:53:39,605 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 17:53:39,606 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 17:53:39,606 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a 2023-02-13 17:53:39,634 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 17:53:39,640 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 17:53:39,646 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/hbase/meta/1588230740/info 2023-02-13 17:53:39,648 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 17:53:39,649 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 17:53:39,650 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 17:53:39,654 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/hbase/meta/1588230740/rep_barrier 2023-02-13 17:53:39,655 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 17:53:39,657 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 17:53:39,658 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 17:53:39,662 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/hbase/meta/1588230740/table 2023-02-13 17:53:39,663 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 17:53:39,664 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 17:53:39,666 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/hbase/meta/1588230740 2023-02-13 17:53:39,667 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/hbase/meta/1588230740 2023-02-13 17:53:39,672 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 17:53:39,675 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 17:53:39,678 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 17:53:39,681 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65189379, jitterRate=-0.02860255539417267}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 17:53:39,681 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676310819634Initializing all the Stores at 1676310819636 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676310819636Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676310819640 (+4 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676310819640Cleaning up temporary data from old regions at 1676310819669 (+29 ms)Cleaning up detritus from prior splits at 1676310819670 (+1 ms)Region opened successfully at 1676310819681 (+11 ms) 2023-02-13 17:53:39,681 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 17:53:39,681 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 17:53:39,682 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 17:53:39,682 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 17:53:39,682 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 17:53:39,683 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 17:53:39,683 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676310819681Disabling compacts and flushes for region at 1676310819681Disabling writes for close at 1676310819682 (+1 ms)Writing region close event to WAL at 1676310819683 (+1 ms)Closed at 1676310819683 2023-02-13 17:53:39,688 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 17:53:39,688 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-13 17:53:39,697 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-13 17:53:39,712 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-13 17:53:39,716 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-13 17:53:39,868 DEBUG [jenkins-hbase4:41433] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-02-13 17:53:39,875 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38881,1676310818035, state=OPENING 2023-02-13 17:53:39,885 DEBUG [PEWorker-2] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-13 17:53:39,886 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 17:53:39,887 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 17:53:39,890 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38881,1676310818035}] 2023-02-13 17:53:40,074 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:40,077 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 17:53:40,081 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51222, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 17:53:40,097 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-13 17:53:40,097 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 17:53:40,101 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38881%2C1676310818035.meta, suffix=.meta, logDir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/WALs/jenkins-hbase4.apache.org,38881,1676310818035, archiveDir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/oldWALs, maxLogs=32 2023-02-13 17:53:40,122 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43797,DS-66b31d51-2df0-4c81-9cca-d2d9d4eb5572,DISK] 2023-02-13 17:53:40,126 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/WALs/jenkins-hbase4.apache.org,38881,1676310818035/jenkins-hbase4.apache.org%2C38881%2C1676310818035.meta.1676310820103.meta 2023-02-13 17:53:40,128 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43797,DS-66b31d51-2df0-4c81-9cca-d2d9d4eb5572,DISK]] 2023-02-13 17:53:40,128 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-13 17:53:40,130 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-13 17:53:40,154 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-13 17:53:40,159 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-13 17:53:40,165 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-13 17:53:40,165 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 17:53:40,165 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-13 17:53:40,166 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-13 17:53:40,170 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 17:53:40,172 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/hbase/meta/1588230740/info 2023-02-13 17:53:40,172 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/hbase/meta/1588230740/info 2023-02-13 17:53:40,173 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 17:53:40,173 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 17:53:40,174 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 17:53:40,175 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/hbase/meta/1588230740/rep_barrier 2023-02-13 17:53:40,175 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/hbase/meta/1588230740/rep_barrier 2023-02-13 17:53:40,176 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 17:53:40,177 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 17:53:40,177 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 17:53:40,178 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/hbase/meta/1588230740/table 2023-02-13 17:53:40,179 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/hbase/meta/1588230740/table 2023-02-13 17:53:40,179 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 17:53:40,180 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 17:53:40,183 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/hbase/meta/1588230740 2023-02-13 17:53:40,186 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/hbase/meta/1588230740 2023-02-13 17:53:40,189 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 17:53:40,192 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 17:53:40,193 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70904765, jitterRate=0.05656333267688751}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 17:53:40,193 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676310820166Writing region info on filesystem at 1676310820166Initializing all the Stores at 1676310820169 (+3 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676310820169Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676310820170 (+1 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676310820170Cleaning up temporary data from old regions at 1676310820188 (+18 ms)Cleaning up detritus from prior splits at 1676310820188Running coprocessor post-open hooks at 1676310820193 (+5 ms)Region opened successfully at 1676310820193 2023-02-13 17:53:40,202 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676310820067 2023-02-13 17:53:40,218 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-13 17:53:40,219 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-13 17:53:40,219 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38881,1676310818035, state=OPEN 2023-02-13 17:53:40,222 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-13 17:53:40,222 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 17:53:40,226 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-13 17:53:40,226 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38881,1676310818035 in 332 msec 2023-02-13 17:53:40,232 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-13 17:53:40,232 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 532 msec 2023-02-13 17:53:40,237 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.2050 sec 2023-02-13 17:53:40,237 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676310818109, completionTime=-1 2023-02-13 17:53:40,237 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-02-13 17:53:40,237 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-13 17:53:40,300 DEBUG [hconnection-0x2b04925f-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 17:53:40,303 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51226, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 17:53:40,319 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=1 2023-02-13 17:53:40,319 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676310880319 2023-02-13 17:53:40,319 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676310940319 2023-02-13 17:53:40,320 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 82 msec 2023-02-13 17:53:40,347 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41433,1676310816814-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 17:53:40,347 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41433,1676310816814-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 17:53:40,347 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41433,1676310816814-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 17:53:40,349 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:41433, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 17:53:40,350 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-13 17:53:40,356 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-13 17:53:40,365 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-13 17:53:40,366 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 17:53:40,376 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-13 17:53:40,378 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 17:53:40,381 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 17:53:40,403 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/hbase/namespace/62b401dbb0accf13145c5bbf2c490411 2023-02-13 17:53:40,407 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/hbase/namespace/62b401dbb0accf13145c5bbf2c490411 empty. 2023-02-13 17:53:40,408 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/hbase/namespace/62b401dbb0accf13145c5bbf2c490411 2023-02-13 17:53:40,408 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-13 17:53:40,431 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-13 17:53:40,433 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 62b401dbb0accf13145c5bbf2c490411, NAME => 'hbase:namespace,,1676310820366.62b401dbb0accf13145c5bbf2c490411.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp 2023-02-13 17:53:40,848 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676310820366.62b401dbb0accf13145c5bbf2c490411.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 17:53:40,848 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 62b401dbb0accf13145c5bbf2c490411, disabling compactions & flushes 2023-02-13 17:53:40,848 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676310820366.62b401dbb0accf13145c5bbf2c490411. 2023-02-13 17:53:40,848 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676310820366.62b401dbb0accf13145c5bbf2c490411. 2023-02-13 17:53:40,848 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676310820366.62b401dbb0accf13145c5bbf2c490411. after waiting 0 ms 2023-02-13 17:53:40,848 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676310820366.62b401dbb0accf13145c5bbf2c490411. 2023-02-13 17:53:40,848 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676310820366.62b401dbb0accf13145c5bbf2c490411. 2023-02-13 17:53:40,848 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 62b401dbb0accf13145c5bbf2c490411: Waiting for close lock at 1676310820848Disabling compacts and flushes for region at 1676310820848Disabling writes for close at 1676310820848Writing region close event to WAL at 1676310820848Closed at 1676310820848 2023-02-13 17:53:40,853 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 17:53:40,868 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676310820366.62b401dbb0accf13145c5bbf2c490411.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676310820856"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676310820856"}]},"ts":"1676310820856"} 2023-02-13 17:53:40,892 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 17:53:40,894 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 17:53:40,898 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676310820894"}]},"ts":"1676310820894"} 2023-02-13 17:53:40,901 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-13 17:53:40,910 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=62b401dbb0accf13145c5bbf2c490411, ASSIGN}] 2023-02-13 17:53:40,913 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=62b401dbb0accf13145c5bbf2c490411, ASSIGN 2023-02-13 17:53:40,915 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=62b401dbb0accf13145c5bbf2c490411, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38881,1676310818035; forceNewPlan=false, retain=false 2023-02-13 17:53:41,066 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=62b401dbb0accf13145c5bbf2c490411, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:41,066 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676310820366.62b401dbb0accf13145c5bbf2c490411.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676310821065"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676310821065"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676310821065"}]},"ts":"1676310821065"} 2023-02-13 17:53:41,071 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 62b401dbb0accf13145c5bbf2c490411, server=jenkins-hbase4.apache.org,38881,1676310818035}] 2023-02-13 17:53:41,232 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676310820366.62b401dbb0accf13145c5bbf2c490411. 2023-02-13 17:53:41,232 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 62b401dbb0accf13145c5bbf2c490411, NAME => 'hbase:namespace,,1676310820366.62b401dbb0accf13145c5bbf2c490411.', STARTKEY => '', ENDKEY => ''} 2023-02-13 17:53:41,233 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 62b401dbb0accf13145c5bbf2c490411 2023-02-13 17:53:41,233 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676310820366.62b401dbb0accf13145c5bbf2c490411.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 17:53:41,233 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 62b401dbb0accf13145c5bbf2c490411 2023-02-13 17:53:41,233 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 62b401dbb0accf13145c5bbf2c490411 2023-02-13 17:53:41,235 INFO [StoreOpener-62b401dbb0accf13145c5bbf2c490411-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 62b401dbb0accf13145c5bbf2c490411 2023-02-13 17:53:41,238 DEBUG [StoreOpener-62b401dbb0accf13145c5bbf2c490411-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/hbase/namespace/62b401dbb0accf13145c5bbf2c490411/info 2023-02-13 17:53:41,238 DEBUG [StoreOpener-62b401dbb0accf13145c5bbf2c490411-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/hbase/namespace/62b401dbb0accf13145c5bbf2c490411/info 2023-02-13 17:53:41,238 INFO [StoreOpener-62b401dbb0accf13145c5bbf2c490411-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 62b401dbb0accf13145c5bbf2c490411 columnFamilyName info 2023-02-13 17:53:41,239 INFO [StoreOpener-62b401dbb0accf13145c5bbf2c490411-1] regionserver.HStore(310): Store=62b401dbb0accf13145c5bbf2c490411/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 17:53:41,241 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/hbase/namespace/62b401dbb0accf13145c5bbf2c490411 2023-02-13 17:53:41,241 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/hbase/namespace/62b401dbb0accf13145c5bbf2c490411 2023-02-13 17:53:41,246 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 62b401dbb0accf13145c5bbf2c490411 2023-02-13 17:53:41,249 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/hbase/namespace/62b401dbb0accf13145c5bbf2c490411/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 17:53:41,250 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 62b401dbb0accf13145c5bbf2c490411; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73251167, jitterRate=0.09152744710445404}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 17:53:41,250 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 62b401dbb0accf13145c5bbf2c490411: Running coprocessor pre-open hook at 1676310821234Writing region info on filesystem at 1676310821234Initializing all the Stores at 1676310821235 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676310821235Cleaning up temporary data from old regions at 1676310821242 (+7 ms)Cleaning up detritus from prior splits at 1676310821243 (+1 ms)Running coprocessor post-open hooks at 1676310821250 (+7 ms)Region opened successfully at 1676310821250 2023-02-13 17:53:41,253 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676310820366.62b401dbb0accf13145c5bbf2c490411., pid=6, masterSystemTime=1676310821224 2023-02-13 17:53:41,256 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676310820366.62b401dbb0accf13145c5bbf2c490411. 2023-02-13 17:53:41,257 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676310820366.62b401dbb0accf13145c5bbf2c490411. 2023-02-13 17:53:41,258 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=62b401dbb0accf13145c5bbf2c490411, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:41,258 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676310820366.62b401dbb0accf13145c5bbf2c490411.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676310821257"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676310821257"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676310821257"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676310821257"}]},"ts":"1676310821257"} 2023-02-13 17:53:41,268 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-13 17:53:41,268 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 62b401dbb0accf13145c5bbf2c490411, server=jenkins-hbase4.apache.org,38881,1676310818035 in 193 msec 2023-02-13 17:53:41,272 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-13 17:53:41,272 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=62b401dbb0accf13145c5bbf2c490411, ASSIGN in 358 msec 2023-02-13 17:53:41,274 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 17:53:41,274 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676310821274"}]},"ts":"1676310821274"} 2023-02-13 17:53:41,277 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-13 17:53:41,281 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-13 17:53:41,281 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 17:53:41,282 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-13 17:53:41,282 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 17:53:41,285 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 914 msec 2023-02-13 17:53:41,331 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-13 17:53:41,350 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 17:53:41,357 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 38 msec 2023-02-13 17:53:41,365 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-13 17:53:41,377 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 17:53:41,382 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 17 msec 2023-02-13 17:53:41,395 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-13 17:53:41,397 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-13 17:53:41,397 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 3.276sec 2023-02-13 17:53:41,399 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-13 17:53:41,401 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-13 17:53:41,401 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-13 17:53:41,402 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41433,1676310816814-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-13 17:53:41,403 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41433,1676310816814-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-13 17:53:41,416 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-13 17:53:41,494 DEBUG [Listener at localhost/35343] zookeeper.ReadOnlyZKClient(139): Connect 0x5759ba4d to 127.0.0.1:64825 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 17:53:41,499 DEBUG [Listener at localhost/35343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@449b853a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 17:53:41,514 DEBUG [hconnection-0x684e302b-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 17:53:41,528 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51236, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 17:53:41,540 INFO [Listener at localhost/35343] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,41433,1676310816814 2023-02-13 17:53:41,542 DEBUG [Listener at localhost/35343] zookeeper.ReadOnlyZKClient(139): Connect 0x47652242 to 127.0.0.1:64825 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 17:53:41,550 DEBUG [Listener at localhost/35343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@143ae868, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 17:53:41,550 INFO [Listener at localhost/35343] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 17:53:41,570 INFO [Listener at localhost/35343] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=209, OpenFileDescriptor=475, MaxFileDescriptor=60000, SystemLoadAverage=412, ProcessCount=168, AvailableMemoryMB=1524 2023-02-13 17:53:41,581 DEBUG [Listener at localhost/35343] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 17:53:41,584 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40424, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 17:53:41,596 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-13 17:53:41,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:41,600 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 17:53:41,602 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 17:53:41,604 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthly" procId is: 9 2023-02-13 17:53:41,605 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a 2023-02-13 17:53:41,606 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a empty. 2023-02-13 17:53:41,608 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a 2023-02-13 17:53:41,608 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthly regions 2023-02-13 17:53:41,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-13 17:53:41,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-13 17:53:41,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-13 17:53:42,024 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-02-13 17:53:42,026 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(7671): creating {ENCODED => 78541a6966cb9a690d8fb6a7bfe8fd0a, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp 2023-02-13 17:53:42,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-13 17:53:42,439 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 17:53:42,440 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1603): Closing 78541a6966cb9a690d8fb6a7bfe8fd0a, disabling compactions & flushes 2023-02-13 17:53:42,440 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a. 2023-02-13 17:53:42,440 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a. 2023-02-13 17:53:42,440 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a. after waiting 0 ms 2023-02-13 17:53:42,440 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a. 2023-02-13 17:53:42,440 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a. 2023-02-13 17:53:42,440 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1557): Region close journal for 78541a6966cb9a690d8fb6a7bfe8fd0a: Waiting for close lock at 1676310822440Disabling compacts and flushes for region at 1676310822440Disabling writes for close at 1676310822440Writing region close event to WAL at 1676310822440Closed at 1676310822440 2023-02-13 17:53:42,445 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 17:53:42,447 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676310822446"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676310822446"}]},"ts":"1676310822446"} 2023-02-13 17:53:42,449 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 17:53:42,451 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 17:53:42,451 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676310822451"}]},"ts":"1676310822451"} 2023-02-13 17:53:42,454 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLING in hbase:meta 2023-02-13 17:53:42,612 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=78541a6966cb9a690d8fb6a7bfe8fd0a, ASSIGN}] 2023-02-13 17:53:42,615 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=78541a6966cb9a690d8fb6a7bfe8fd0a, ASSIGN 2023-02-13 17:53:42,617 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=78541a6966cb9a690d8fb6a7bfe8fd0a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38881,1676310818035; forceNewPlan=false, retain=false 2023-02-13 17:53:42,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-13 17:53:42,768 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=78541a6966cb9a690d8fb6a7bfe8fd0a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:42,768 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676310822768"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676310822768"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676310822768"}]},"ts":"1676310822768"} 2023-02-13 17:53:42,772 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 78541a6966cb9a690d8fb6a7bfe8fd0a, server=jenkins-hbase4.apache.org,38881,1676310818035}] 2023-02-13 17:53:42,931 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a. 2023-02-13 17:53:42,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 78541a6966cb9a690d8fb6a7bfe8fd0a, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a.', STARTKEY => '', ENDKEY => ''} 2023-02-13 17:53:42,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 78541a6966cb9a690d8fb6a7bfe8fd0a 2023-02-13 17:53:42,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 17:53:42,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 78541a6966cb9a690d8fb6a7bfe8fd0a 2023-02-13 17:53:42,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 78541a6966cb9a690d8fb6a7bfe8fd0a 2023-02-13 17:53:42,936 INFO [StoreOpener-78541a6966cb9a690d8fb6a7bfe8fd0a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 78541a6966cb9a690d8fb6a7bfe8fd0a 2023-02-13 17:53:42,939 DEBUG [StoreOpener-78541a6966cb9a690d8fb6a7bfe8fd0a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1 2023-02-13 17:53:42,939 DEBUG [StoreOpener-78541a6966cb9a690d8fb6a7bfe8fd0a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1 2023-02-13 17:53:42,942 INFO [StoreOpener-78541a6966cb9a690d8fb6a7bfe8fd0a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 78541a6966cb9a690d8fb6a7bfe8fd0a columnFamilyName family1 2023-02-13 17:53:42,945 INFO [StoreOpener-78541a6966cb9a690d8fb6a7bfe8fd0a-1] regionserver.HStore(310): Store=78541a6966cb9a690d8fb6a7bfe8fd0a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 17:53:42,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a 2023-02-13 17:53:42,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a 2023-02-13 17:53:42,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 78541a6966cb9a690d8fb6a7bfe8fd0a 2023-02-13 17:53:42,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 17:53:42,958 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 78541a6966cb9a690d8fb6a7bfe8fd0a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67307834, jitterRate=0.002964884042739868}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 17:53:42,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 78541a6966cb9a690d8fb6a7bfe8fd0a: Running coprocessor pre-open hook at 1676310822932Writing region info on filesystem at 1676310822932Initializing all the Stores at 1676310822934 (+2 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1676310822934Cleaning up temporary data from old regions at 1676310822949 (+15 ms)Cleaning up detritus from prior splits at 1676310822950 (+1 ms)Running coprocessor post-open hooks at 1676310822958 (+8 ms)Region opened successfully at 1676310822958 2023-02-13 17:53:42,960 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a., pid=11, masterSystemTime=1676310822925 2023-02-13 17:53:42,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a. 2023-02-13 17:53:42,963 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a. 2023-02-13 17:53:42,964 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=78541a6966cb9a690d8fb6a7bfe8fd0a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:42,965 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676310822964"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676310822964"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676310822964"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676310822964"}]},"ts":"1676310822964"} 2023-02-13 17:53:42,971 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-13 17:53:42,971 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 78541a6966cb9a690d8fb6a7bfe8fd0a, server=jenkins-hbase4.apache.org,38881,1676310818035 in 196 msec 2023-02-13 17:53:42,974 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-02-13 17:53:42,975 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=78541a6966cb9a690d8fb6a7bfe8fd0a, ASSIGN in 359 msec 2023-02-13 17:53:42,975 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 17:53:42,976 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676310822976"}]},"ts":"1676310822976"} 2023-02-13 17:53:42,978 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLED in hbase:meta 2023-02-13 17:53:42,981 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 17:53:42,983 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.3850 sec 2023-02-13 17:53:43,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-13 17:53:43,727 INFO [Listener at localhost/35343] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthly, procId: 9 completed 2023-02-13 17:53:43,744 DEBUG [hconnection-0x23d918c4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 17:53:43,747 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34476, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 17:53:43,886 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:53:43,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:43,894 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 17:53:43,894 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:53:43,894 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-13 17:53:43,895 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-13 17:53:43,895 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:43,895 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:43,897 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:53:43,897 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:43,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:53:43,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:53:43,897 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:43,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:43,897 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:53:43,898 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:43,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:53:43,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:43,899 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:43,901 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:43,901 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-13 17:53:43,901 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:53:43,902 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-13 17:53:43,902 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:53:43,902 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a. 2023-02-13 17:53:43,903 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:53:43,903 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a. started... 2023-02-13 17:53:43,904 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 78541a6966cb9a690d8fb6a7bfe8fd0a 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-13 17:53:44,445 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130f625f63cc07b42bfb841b6eaf53a1fe1 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130f625f63cc07b42bfb841b6eaf53a1fe1 2023-02-13 17:53:44,459 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/.tmp/family1/263f76ae5c2a42a1ab4a94426278c0f2 2023-02-13 17:53:44,468 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/.tmp/family1/263f76ae5c2a42a1ab4a94426278c0f2 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/263f76ae5c2a42a1ab4a94426278c0f2 2023-02-13 17:53:44,476 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/263f76ae5c2a42a1ab4a94426278c0f2, entries=1000, sequenceid=5, filesize=175.8 K 2023-02-13 17:53:44,478 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 78541a6966cb9a690d8fb6a7bfe8fd0a in 574ms, sequenceid=5, compaction requested=false 2023-02-13 17:53:44,480 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 17:53:44,482 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 78541a6966cb9a690d8fb6a7bfe8fd0a: 2023-02-13 17:53:44,482 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a. 2023-02-13 17:53:44,482 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:53:44,483 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:53:44,483 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:44,483 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-13 17:53:44,483 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-13 17:53:44,487 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:44,487 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:44,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:44,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:53:44,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:53:44,488 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:44,488 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:53:44,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:53:44,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:53:44,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:44,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:44,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:53:44,490 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-13 17:53:44,490 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3816ec9f[Count = 0] remaining members to acquire global barrier 2023-02-13 17:53:44,490 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-13 17:53:44,490 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:44,492 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:44,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:44,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:44,492 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-13 17:53:44,492 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:44,492 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:53:44,492 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-13 17:53:44,492 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:53:44,494 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:44,494 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-13 17:53:44,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:44,494 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:53:44,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:53:44,495 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-13 17:53:44,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:53:44,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:53:44,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:53:44,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:44,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:44,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:53:44,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:44,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:44,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:53:44,498 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-13 17:53:44,498 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-13 17:53:44,498 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:53:44,498 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:53:44,498 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:44,498 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:53:44,501 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:44,501 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:44,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:44,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:44,501 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:53:44,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:44,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:53:44,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:53:44,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:53:44,502 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:44,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:53:44,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:53:44,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:44,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:44,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:53:44,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:44,503 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:44,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:44,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:53:44,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:44,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:44,512 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:44,512 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:53:44,512 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:44,512 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:53:44,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:53:44,512 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:53:44,512 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:53:44,512 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 17:53:44,512 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:44,513 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:53:44,513 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:44,513 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:44,513 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:44,513 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:44,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:53:44,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:53:44,515 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-13 17:53:44,515 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:53:44,615 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:53:44,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:53:44,629 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:53:44,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-13 17:53:44,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:44,631 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 17:53:44,632 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:53:44,632 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-13 17:53:44,632 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-13 17:53:44,633 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:44,633 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:44,634 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:53:44,634 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:44,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:53:44,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:53:44,635 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:44,635 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:53:44,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:44,635 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:44,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:53:44,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:44,636 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:44,636 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-13 17:53:44,636 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:44,636 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-13 17:53:44,636 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:53:44,637 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-13 17:53:44,637 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:53:44,637 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:53:44,637 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a. 2023-02-13 17:53:44,637 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a. started... 2023-02-13 17:53:44,637 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 78541a6966cb9a690d8fb6a7bfe8fd0a 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-13 17:53:45,063 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511280a35a943043b45008d364d0caafe4221 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511280a35a943043b45008d364d0caafe4221 2023-02-13 17:53:45,475 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/.tmp/family1/7453f5e272b04625967ee3a171adc1b9 2023-02-13 17:53:45,485 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/.tmp/family1/7453f5e272b04625967ee3a171adc1b9 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/7453f5e272b04625967ee3a171adc1b9 2023-02-13 17:53:45,495 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/7453f5e272b04625967ee3a171adc1b9, entries=1, sequenceid=9, filesize=5.0 K 2023-02-13 17:53:45,496 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 78541a6966cb9a690d8fb6a7bfe8fd0a in 859ms, sequenceid=9, compaction requested=false 2023-02-13 17:53:45,496 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 78541a6966cb9a690d8fb6a7bfe8fd0a: 2023-02-13 17:53:45,496 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a. 2023-02-13 17:53:45,496 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:53:45,497 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:53:45,497 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:45,497 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-13 17:53:45,497 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-13 17:53:45,499 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:45,499 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:45,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:45,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:53:45,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:53:45,499 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:45,499 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:53:45,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:53:45,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:53:45,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:45,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:45,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:53:45,501 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-13 17:53:45,501 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7986a6a1[Count = 0] remaining members to acquire global barrier 2023-02-13 17:53:45,501 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-13 17:53:45,501 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:45,502 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:45,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:45,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:45,503 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-13 17:53:45,503 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-13 17:53:45,503 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:53:45,503 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:45,503 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:53:45,506 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:45,506 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-13 17:53:45,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:45,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:53:45,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:53:45,506 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:53:45,506 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-13 17:53:45,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:53:45,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:53:45,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:45,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:45,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:53:45,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:45,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:45,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:53:45,509 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-13 17:53:45,509 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-13 17:53:45,509 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:53:45,509 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:53:45,509 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:45,509 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:53:45,514 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:45,514 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:45,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:45,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:45,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:53:45,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:53:45,514 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:53:45,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:45,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:53:45,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:53:45,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:53:45,515 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:45,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:45,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:45,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:53:45,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:45,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:45,517 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:45,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:53:45,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:45,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:45,520 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:45,520 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:53:45,520 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:45,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:53:45,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:53:45,520 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:53:45,520 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 17:53:45,521 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:53:45,520 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:53:45,520 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:45,521 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:45,521 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:45,521 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:45,521 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:45,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:53:45,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:53:45,521 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-13 17:53:45,521 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:53:45,622 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:53:45,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:53:45,632 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:53:45,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-13 17:53:45,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:45,635 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 17:53:45,635 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:53:45,635 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-13 17:53:45,635 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-13 17:53:45,636 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:45,636 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:45,639 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:53:45,639 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:45,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:53:45,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:53:45,639 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:45,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:45,639 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:53:45,640 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:45,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:53:45,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:45,640 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:45,647 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-13 17:53:45,647 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:45,647 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-13 17:53:45,648 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:53:45,648 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-13 17:53:45,649 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:53:45,649 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:53:45,649 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a. 2023-02-13 17:53:45,649 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a. started... 2023-02-13 17:53:45,649 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 78541a6966cb9a690d8fb6a7bfe8fd0a 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 17:53:45,685 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 17:53:45,752 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-13 17:53:45,753 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-13 17:53:46,082 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201b30c5125375f4b41bfedf042f8f58095 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201b30c5125375f4b41bfedf042f8f58095 2023-02-13 17:53:46,101 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/.tmp/family1/3f2d4e237e6c400d9ff5b49045cb4484 2023-02-13 17:53:46,113 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/.tmp/family1/3f2d4e237e6c400d9ff5b49045cb4484 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/3f2d4e237e6c400d9ff5b49045cb4484 2023-02-13 17:53:46,122 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/3f2d4e237e6c400d9ff5b49045cb4484, entries=1, sequenceid=13, filesize=5.0 K 2023-02-13 17:53:46,124 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 78541a6966cb9a690d8fb6a7bfe8fd0a in 475ms, sequenceid=13, compaction requested=true 2023-02-13 17:53:46,124 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 78541a6966cb9a690d8fb6a7bfe8fd0a: 2023-02-13 17:53:46,124 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a. 2023-02-13 17:53:46,124 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:53:46,125 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:53:46,125 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:46,125 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-13 17:53:46,125 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-13 17:53:46,127 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:46,127 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:46,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:46,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:53:46,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:53:46,128 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:46,128 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:53:46,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:53:46,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:53:46,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:46,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:46,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:53:46,133 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-13 17:53:46,133 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@23528d05[Count = 0] remaining members to acquire global barrier 2023-02-13 17:53:46,133 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-13 17:53:46,133 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:46,134 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:46,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:46,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:46,135 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-13 17:53:46,135 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-13 17:53:46,135 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:53:46,136 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:46,136 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:53:46,137 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-13 17:53:46,137 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:46,137 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:53:46,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:46,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:53:46,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:53:46,137 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-13 17:53:46,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:53:46,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:53:46,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:46,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:46,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:53:46,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:46,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:46,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:53:46,144 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-13 17:53:46,145 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-13 17:53:46,145 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:53:46,145 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:53:46,145 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:46,145 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:53:46,149 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:46,149 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:46,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:46,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:46,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:46,150 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:53:46,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:53:46,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:53:46,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:53:46,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:53:46,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:53:46,151 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:46,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:46,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:53:46,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:46,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:46,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:46,154 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:46,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:53:46,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:46,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:46,164 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:46,164 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:46,164 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:53:46,164 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:46,164 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:46,164 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:53:46,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:53:46,164 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 17:53:46,164 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:53:46,164 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:53:46,164 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:46,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:53:46,165 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:46,165 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:46,165 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-13 17:53:46,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:53:46,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:53:46,165 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:53:46,266 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:53:46,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:53:46,275 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:53:46,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-13 17:53:46,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:46,279 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 17:53:46,280 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:53:46,280 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-13 17:53:46,280 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-13 17:53:46,281 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:46,281 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:46,282 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:53:46,282 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:46,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:53:46,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:53:46,283 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:46,283 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:53:46,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:46,284 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:46,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:53:46,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:46,284 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:46,285 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-13 17:53:46,285 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:46,285 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-13 17:53:46,285 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:53:46,285 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-13 17:53:46,285 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:53:46,286 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:53:46,286 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a. 2023-02-13 17:53:46,286 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a. started... 2023-02-13 17:53:46,286 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 78541a6966cb9a690d8fb6a7bfe8fd0a 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 17:53:46,316 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205163ec0944bbd4dee8f3ddf83b3333b28 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205163ec0944bbd4dee8f3ddf83b3333b28 2023-02-13 17:53:46,742 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/.tmp/family1/6f7d28aa0d5c44f597bff4961265aa9b 2023-02-13 17:53:46,751 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/.tmp/family1/6f7d28aa0d5c44f597bff4961265aa9b as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/6f7d28aa0d5c44f597bff4961265aa9b 2023-02-13 17:53:46,761 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/6f7d28aa0d5c44f597bff4961265aa9b, entries=1, sequenceid=17, filesize=5.0 K 2023-02-13 17:53:46,763 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 78541a6966cb9a690d8fb6a7bfe8fd0a in 477ms, sequenceid=17, compaction requested=true 2023-02-13 17:53:46,763 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 78541a6966cb9a690d8fb6a7bfe8fd0a: 2023-02-13 17:53:46,763 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a. 2023-02-13 17:53:46,763 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:53:46,764 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:53:46,764 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:46,764 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-13 17:53:46,764 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-13 17:53:46,766 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:46,766 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:46,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:46,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:53:46,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:53:46,767 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:46,767 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:53:46,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:53:46,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:53:46,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:46,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:46,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:53:46,769 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-13 17:53:46,769 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@dd6d6bf[Count = 0] remaining members to acquire global barrier 2023-02-13 17:53:46,769 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-13 17:53:46,769 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:46,771 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:46,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:46,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:46,771 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-13 17:53:46,771 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-13 17:53:46,771 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:53:46,771 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:46,771 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:53:46,773 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-13 17:53:46,773 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:46,773 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:53:46,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:46,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:53:46,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:53:46,773 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-13 17:53:46,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:53:46,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:53:46,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:46,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:46,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:53:46,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:46,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:46,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:53:46,777 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-13 17:53:46,777 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-13 17:53:46,777 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:53:46,777 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:53:46,777 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:46,778 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:53:46,780 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:46,780 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:46,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:46,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:53:46,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:53:46,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:46,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:46,780 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:53:46,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:53:46,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:53:46,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:53:46,781 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:46,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:46,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:46,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:53:46,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:46,782 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:46,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:46,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:53:46,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:46,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:46,787 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:53:46,787 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:46,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:53:46,787 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-13 17:53:46,787 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:53:46,787 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 17:53:46,788 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:53:46,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:53:46,787 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:53:46,787 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:46,788 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:46,788 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:46,788 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-13 17:53:46,788 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:46,788 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:53:46,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:53:46,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:53:46,789 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:46,789 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:46,889 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:53:46,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:53:46,899 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:53:46,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-13 17:53:46,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:46,902 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 17:53:46,902 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:53:46,903 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-13 17:53:46,903 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-13 17:53:46,903 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:46,903 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:46,906 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:46,906 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:53:46,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:53:46,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:53:46,906 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:46,906 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:53:46,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:46,907 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:46,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:53:46,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:46,907 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:46,907 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-13 17:53:46,908 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:46,908 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-13 17:53:46,908 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:53:46,908 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-13 17:53:46,908 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:53:46,908 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:53:46,908 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a. 2023-02-13 17:53:46,909 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a. started... 2023-02-13 17:53:46,909 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 78541a6966cb9a690d8fb6a7bfe8fd0a 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 17:53:46,976 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-13 17:53:46,976 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-13 17:53:47,332 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512286ab1ea80d27b497b887058834a09e1b4 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512286ab1ea80d27b497b887058834a09e1b4 2023-02-13 17:53:47,744 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/.tmp/family1/0198f59cf22449b6a8c167aa869d84c3 2023-02-13 17:53:47,753 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/.tmp/family1/0198f59cf22449b6a8c167aa869d84c3 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/0198f59cf22449b6a8c167aa869d84c3 2023-02-13 17:53:47,762 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/0198f59cf22449b6a8c167aa869d84c3, entries=1, sequenceid=21, filesize=5.0 K 2023-02-13 17:53:47,764 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 78541a6966cb9a690d8fb6a7bfe8fd0a in 855ms, sequenceid=21, compaction requested=true 2023-02-13 17:53:47,764 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 78541a6966cb9a690d8fb6a7bfe8fd0a: 2023-02-13 17:53:47,764 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a. 2023-02-13 17:53:47,764 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:53:47,765 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:53:47,765 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:47,765 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-13 17:53:47,765 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-13 17:53:47,772 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:47,772 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:47,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:47,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:53:47,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:53:47,772 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:47,772 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:53:47,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:53:47,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:53:47,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:47,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:47,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:53:47,774 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-13 17:53:47,774 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2aba18e[Count = 0] remaining members to acquire global barrier 2023-02-13 17:53:47,774 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-13 17:53:47,774 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:47,776 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:47,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:47,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:47,776 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-13 17:53:47,776 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-13 17:53:47,776 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:53:47,776 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:47,776 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:53:47,778 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:47,778 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-13 17:53:47,778 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:53:47,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:47,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:53:47,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:53:47,778 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-13 17:53:47,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:53:47,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:53:47,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:47,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:47,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:53:47,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:47,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:47,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:53:47,781 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-13 17:53:47,781 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-13 17:53:47,782 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:53:47,782 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:53:47,782 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:47,782 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:53:47,783 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:47,783 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:47,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:47,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:47,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:53:47,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:53:47,784 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:53:47,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:47,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:53:47,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:53:47,784 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:47,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:53:47,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:47,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:47,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:53:47,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:47,786 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:47,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:47,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:53:47,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:47,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:47,790 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:47,790 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:47,790 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:53:47,790 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:47,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:53:47,790 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 17:53:47,790 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-13 17:53:47,790 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:53:47,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:53:47,790 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:53:47,790 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:47,790 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:53:47,791 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:47,791 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:47,791 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:47,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:53:47,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:53:47,791 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-13 17:53:47,791 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:53:47,891 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:53:47,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:53:47,901 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:53:47,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-13 17:53:47,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:47,904 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 17:53:47,904 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:53:47,904 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-13 17:53:47,904 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-13 17:53:47,905 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:47,905 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:47,906 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:47,906 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:53:47,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:53:47,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:53:47,907 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:47,907 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:53:47,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:47,907 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:47,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:53:47,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:47,908 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:47,908 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-13 17:53:47,908 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:47,908 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-13 17:53:47,908 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:53:47,909 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-13 17:53:47,909 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:53:47,909 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:53:47,909 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a. 2023-02-13 17:53:47,909 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a. started... 2023-02-13 17:53:47,909 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 78541a6966cb9a690d8fb6a7bfe8fd0a 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 17:53:47,935 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231fadc65d2fe274c8dbacc8443f5c2b777 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231fadc65d2fe274c8dbacc8443f5c2b777 2023-02-13 17:53:48,347 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/.tmp/family1/b9a2be0e27b2473589f8772c77605b5a 2023-02-13 17:53:48,357 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/.tmp/family1/b9a2be0e27b2473589f8772c77605b5a as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/b9a2be0e27b2473589f8772c77605b5a 2023-02-13 17:53:48,369 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/b9a2be0e27b2473589f8772c77605b5a, entries=1, sequenceid=25, filesize=5.0 K 2023-02-13 17:53:48,371 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 78541a6966cb9a690d8fb6a7bfe8fd0a in 462ms, sequenceid=25, compaction requested=true 2023-02-13 17:53:48,371 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 78541a6966cb9a690d8fb6a7bfe8fd0a: 2023-02-13 17:53:48,371 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a. 2023-02-13 17:53:48,371 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:53:48,372 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:53:48,372 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:48,372 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-13 17:53:48,372 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-13 17:53:48,374 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:48,374 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:48,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:48,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:53:48,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:53:48,375 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:48,375 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:53:48,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:53:48,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:53:48,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:48,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:48,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:53:48,379 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-13 17:53:48,379 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4ed4acd4[Count = 0] remaining members to acquire global barrier 2023-02-13 17:53:48,379 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-13 17:53:48,379 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:48,381 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:48,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:48,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:48,381 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-13 17:53:48,381 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-13 17:53:48,381 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:53:48,381 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:48,381 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:53:48,383 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:48,383 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-13 17:53:48,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:48,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:53:48,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:53:48,383 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:53:48,383 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-13 17:53:48,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:53:48,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:53:48,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:48,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:48,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:53:48,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:48,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:48,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:53:48,387 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-13 17:53:48,387 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-13 17:53:48,387 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:53:48,387 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:53:48,387 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:48,387 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:53:48,390 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:48,390 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:48,390 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:53:48,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:48,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:48,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:48,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:53:48,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:53:48,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:53:48,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:53:48,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:53:48,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:48,391 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:48,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:48,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:53:48,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:48,393 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:48,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:48,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:53:48,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:48,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:48,397 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:53:48,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:53:48,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:53:48,397 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:53:48,397 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-13 17:53:48,397 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:48,398 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:53:48,398 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:48,397 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 17:53:48,398 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:53:48,398 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:53:48,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:53:48,399 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-13 17:53:48,398 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:48,399 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:48,399 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:48,399 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:48,399 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:48,399 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:53:48,499 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:53:48,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:53:48,509 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:53:48,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-13 17:53:48,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:48,512 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 17:53:48,512 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:53:48,513 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-13 17:53:48,513 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-13 17:53:48,514 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:48,514 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:48,515 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:48,515 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:53:48,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:53:48,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:53:48,515 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:48,515 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:53:48,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:48,516 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:48,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:53:48,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:48,517 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:48,517 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-13 17:53:48,517 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:48,517 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-13 17:53:48,517 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:53:48,518 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-13 17:53:48,518 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:53:48,518 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:53:48,518 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a. 2023-02-13 17:53:48,518 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a. started... 2023-02-13 17:53:48,518 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 78541a6966cb9a690d8fb6a7bfe8fd0a 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 17:53:48,552 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101fd928b936e5243a0ab5173eaae4d77dc to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101fd928b936e5243a0ab5173eaae4d77dc 2023-02-13 17:53:48,569 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/.tmp/family1/6821b8f37697433290703c30838eb6fc 2023-02-13 17:53:48,582 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/.tmp/family1/6821b8f37697433290703c30838eb6fc as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/6821b8f37697433290703c30838eb6fc 2023-02-13 17:53:48,596 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/6821b8f37697433290703c30838eb6fc, entries=1, sequenceid=29, filesize=5.0 K 2023-02-13 17:53:48,597 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 78541a6966cb9a690d8fb6a7bfe8fd0a in 79ms, sequenceid=29, compaction requested=true 2023-02-13 17:53:48,597 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 78541a6966cb9a690d8fb6a7bfe8fd0a: 2023-02-13 17:53:48,597 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a. 2023-02-13 17:53:48,598 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:53:48,598 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:53:48,598 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:48,598 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-13 17:53:48,598 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-13 17:53:48,601 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:48,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:48,601 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:48,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:53:48,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:53:48,602 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:48,602 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:53:48,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:53:48,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:53:48,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:48,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:48,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:53:48,604 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-13 17:53:48,604 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@79d93aae[Count = 0] remaining members to acquire global barrier 2023-02-13 17:53:48,604 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-13 17:53:48,605 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:48,606 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:48,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:48,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:48,607 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-13 17:53:48,607 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:48,607 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:53:48,607 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-13 17:53:48,607 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:53:48,609 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-13 17:53:48,609 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:48,609 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:53:48,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:48,610 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-13 17:53:48,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:53:48,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:53:48,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:53:48,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:53:48,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:48,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:48,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:53:48,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:48,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:48,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:53:48,613 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-13 17:53:48,613 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-13 17:53:48,614 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:53:48,614 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:53:48,614 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:48,614 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:53:48,615 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:48,615 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:48,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:48,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:53:48,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:53:48,616 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:53:48,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:48,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:48,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:53:48,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:53:48,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:53:48,617 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:48,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:48,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:48,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:53:48,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:48,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:48,618 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:48,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:53:48,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:48,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:48,623 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:48,624 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:48,624 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:53:48,624 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:53:48,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:53:48,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:53:48,624 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:48,624 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-13 17:53:48,624 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 17:53:48,625 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:53:48,624 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:53:48,624 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:48,625 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:48,625 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:48,625 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:48,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:53:48,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:53:48,625 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-13 17:53:48,625 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:53:48,725 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:53:48,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:53:48,736 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:53:48,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-13 17:53:48,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:48,740 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 17:53:48,740 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:53:48,741 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-13 17:53:48,741 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-13 17:53:48,741 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:48,741 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:48,744 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:48,744 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:53:48,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:53:48,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:53:48,744 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:48,744 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:53:48,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:48,745 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:48,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:53:48,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:48,746 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:48,746 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-13 17:53:48,746 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:48,746 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-13 17:53:48,746 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:53:48,746 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-13 17:53:48,747 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:53:48,747 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:53:48,747 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a. 2023-02-13 17:53:48,747 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a. started... 2023-02-13 17:53:48,747 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 78541a6966cb9a690d8fb6a7bfe8fd0a 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 17:53:48,776 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103e01b334a29504fd5892f63903a665498 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103e01b334a29504fd5892f63903a665498 2023-02-13 17:53:49,209 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/.tmp/family1/c4bcd19a42fc47819b581b1fdc68b3a0 2023-02-13 17:53:49,222 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/.tmp/family1/c4bcd19a42fc47819b581b1fdc68b3a0 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/c4bcd19a42fc47819b581b1fdc68b3a0 2023-02-13 17:53:49,229 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/c4bcd19a42fc47819b581b1fdc68b3a0, entries=1, sequenceid=33, filesize=5.0 K 2023-02-13 17:53:49,231 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 78541a6966cb9a690d8fb6a7bfe8fd0a in 483ms, sequenceid=33, compaction requested=true 2023-02-13 17:53:49,231 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 78541a6966cb9a690d8fb6a7bfe8fd0a: 2023-02-13 17:53:49,231 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a. 2023-02-13 17:53:49,231 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:53:49,231 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:53:49,231 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:49,231 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-13 17:53:49,231 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-13 17:53:49,233 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:49,233 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:49,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:49,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:53:49,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:53:49,234 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:49,234 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:53:49,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:53:49,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:53:49,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:49,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:49,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:53:49,235 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-13 17:53:49,235 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@42817804[Count = 0] remaining members to acquire global barrier 2023-02-13 17:53:49,235 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-13 17:53:49,236 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:49,237 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:49,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:49,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:49,237 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-13 17:53:49,237 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-13 17:53:49,237 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:53:49,237 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:49,237 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:53:49,239 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:49,239 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-13 17:53:49,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:49,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:53:49,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:53:49,239 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:53:49,239 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-13 17:53:49,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:53:49,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:53:49,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:49,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:49,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:53:49,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:49,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:49,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:53:49,246 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-13 17:53:49,246 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-13 17:53:49,246 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:53:49,246 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:53:49,246 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:49,246 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:53:49,255 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:49,255 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:49,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:49,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:49,255 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:53:49,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:49,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:53:49,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:53:49,255 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:49,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:53:49,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:53:49,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:53:49,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:49,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:49,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:53:49,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:49,257 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:49,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:49,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:53:49,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:49,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:49,264 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:49,264 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:53:49,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:53:49,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:53:49,265 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:53:49,265 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:49,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:53:49,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:53:49,265 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:49,265 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:49,265 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:49,265 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:49,265 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:49,266 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:53:49,266 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 17:53:49,266 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:53:49,267 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-13 17:53:49,267 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:53:49,367 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:53:49,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:53:49,376 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:53:49,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-13 17:53:49,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:49,379 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 17:53:49,379 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:53:49,379 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-13 17:53:49,379 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-13 17:53:49,380 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:49,380 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:49,381 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:53:49,381 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:49,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:53:49,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:53:49,382 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:49,382 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:53:49,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:49,382 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:49,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:53:49,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:49,382 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:49,383 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-13 17:53:49,383 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:49,384 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-13 17:53:49,384 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:53:49,384 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-13 17:53:49,387 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:53:49,387 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:53:49,387 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a. 2023-02-13 17:53:49,387 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a. started... 2023-02-13 17:53:49,387 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 78541a6966cb9a690d8fb6a7bfe8fd0a 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 17:53:49,842 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907689126b44711423286725e7343ede581 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20150907689126b44711423286725e7343ede581 2023-02-13 17:53:50,252 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/.tmp/family1/f721116528b9480394c401b92098a93a 2023-02-13 17:53:50,262 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/.tmp/family1/f721116528b9480394c401b92098a93a as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/f721116528b9480394c401b92098a93a 2023-02-13 17:53:50,269 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/f721116528b9480394c401b92098a93a, entries=1, sequenceid=37, filesize=5.0 K 2023-02-13 17:53:50,271 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 78541a6966cb9a690d8fb6a7bfe8fd0a in 884ms, sequenceid=37, compaction requested=true 2023-02-13 17:53:50,271 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 78541a6966cb9a690d8fb6a7bfe8fd0a: 2023-02-13 17:53:50,271 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a. 2023-02-13 17:53:50,271 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:53:50,271 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:53:50,271 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:50,271 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-13 17:53:50,271 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-13 17:53:50,273 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:50,273 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:50,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:50,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:53:50,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:53:50,274 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:50,274 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:53:50,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:53:50,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:53:50,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:50,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:50,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:53:50,276 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-13 17:53:50,276 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1df9060b[Count = 0] remaining members to acquire global barrier 2023-02-13 17:53:50,276 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-13 17:53:50,276 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:50,279 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:50,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:50,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:50,279 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-13 17:53:50,279 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-13 17:53:50,279 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:53:50,280 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:50,280 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:53:50,281 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-13 17:53:50,281 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:50,281 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:53:50,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:50,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:53:50,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:53:50,281 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-13 17:53:50,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:53:50,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:53:50,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:50,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:50,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:53:50,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:50,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:50,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:53:50,285 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-13 17:53:50,285 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-13 17:53:50,285 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:53:50,285 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:53:50,285 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:50,285 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:53:50,287 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:50,287 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:50,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:50,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:53:50,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:53:50,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:50,287 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:53:50,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:50,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:53:50,288 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:50,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:53:50,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:53:50,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:50,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:50,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:53:50,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:50,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:50,290 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:50,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:53:50,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:50,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:50,292 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:50,292 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:50,292 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:50,292 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:50,292 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 17:53:50,292 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:53:50,292 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:53:50,292 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:50,292 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:53:50,293 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:50,293 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:53:50,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:53:50,293 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:50,293 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-13 17:53:50,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:53:50,294 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:53:50,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:53:50,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:53:50,394 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:53:50,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:53:50,402 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:53:50,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-13 17:53:50,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:50,405 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 17:53:50,405 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:53:50,405 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-13 17:53:50,405 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-13 17:53:50,406 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:50,406 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:50,409 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:50,409 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:53:50,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:53:50,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:53:50,409 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:50,409 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:53:50,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:50,409 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:50,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:53:50,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:50,410 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:50,410 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-13 17:53:50,410 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:50,410 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-13 17:53:50,410 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:53:50,411 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-13 17:53:50,411 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:53:50,411 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:53:50,411 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a. 2023-02-13 17:53:50,411 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a. started... 2023-02-13 17:53:50,412 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 78541a6966cb9a690d8fb6a7bfe8fd0a 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 17:53:50,831 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120864f52c28bb44139ac87b519288a860c to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151120864f52c28bb44139ac87b519288a860c 2023-02-13 17:53:50,839 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/.tmp/family1/cefa0acd03b440229ca5a828a7389d28 2023-02-13 17:53:50,847 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/.tmp/family1/cefa0acd03b440229ca5a828a7389d28 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/cefa0acd03b440229ca5a828a7389d28 2023-02-13 17:53:50,854 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/cefa0acd03b440229ca5a828a7389d28, entries=1, sequenceid=41, filesize=5.0 K 2023-02-13 17:53:50,856 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 78541a6966cb9a690d8fb6a7bfe8fd0a in 444ms, sequenceid=41, compaction requested=true 2023-02-13 17:53:50,856 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 78541a6966cb9a690d8fb6a7bfe8fd0a: 2023-02-13 17:53:50,856 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a. 2023-02-13 17:53:50,856 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:53:50,857 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:53:50,857 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:50,857 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-13 17:53:50,857 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-13 17:53:50,859 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:50,859 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:50,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:50,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:53:50,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:53:50,859 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:50,859 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:53:50,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:53:50,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:53:50,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:50,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:50,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:53:50,861 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-13 17:53:50,861 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@76a0ab6c[Count = 0] remaining members to acquire global barrier 2023-02-13 17:53:50,861 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-13 17:53:50,861 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:50,862 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:50,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:50,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:50,863 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-13 17:53:50,863 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-13 17:53:50,863 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:53:50,863 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:50,863 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:53:50,869 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-13 17:53:50,869 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:50,869 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:53:50,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:50,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:53:50,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:53:50,869 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-13 17:53:50,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:53:50,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:53:50,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:50,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:50,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:53:50,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:50,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:50,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:53:50,874 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-13 17:53:50,874 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-13 17:53:50,874 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:53:50,874 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:53:50,874 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:50,874 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:53:50,877 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:50,877 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:50,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:50,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:50,877 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:53:50,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:50,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:53:50,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:53:50,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:53:50,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:53:50,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:50,878 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:50,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:53:50,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:50,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:53:50,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:50,880 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:50,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:50,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:53:50,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:50,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:50,882 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:50,883 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:50,883 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:53:50,883 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:50,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:53:50,883 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-13 17:53:50,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:53:50,883 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 17:53:50,883 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:53:50,883 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:53:50,883 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:50,883 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:53:50,883 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:50,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:53:50,883 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:50,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:53:50,883 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:50,884 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-13 17:53:50,884 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:53:50,984 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:53:50,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:53:50,990 DEBUG [Listener at localhost/35343] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 17:53:50,993 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33234, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 17:53:50,994 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41433] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:51,007 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-13 17:53:51,008 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-13 17:53:51,009 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 17:53:51,009 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=12, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676311431009 2023-02-13 17:53:51,011 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-13 17:53:51,016 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-02-13 17:53:51,017 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-13 17:53:51,017 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] zookeeper.ReadOnlyZKClient(139): Connect 0x7c3569a1 to 127.0.0.1:64825 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 17:53:51,024 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@11504815, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 17:53:51,025 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 17:53:51,505 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103b4a7aa6ae69f4aba855851dda3618dc8 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103b4a7aa6ae69f4aba855851dda3618dc8 2023-02-13 17:53:51,506 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-13 17:53:51,525 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 17:53:51,527 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34492, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 17:53:51,540 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 17:53:51,541 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33248, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 17:53:51,576 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/301198f682ff4cc78ea889e7e7d5dabb first=Optional[r3] last=Optional[r6] 2023-02-13 17:53:51,589 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a., hostname=jenkins-hbase4.apache.org,38881,1676310818035, seqNum=2 for row with hfile group [{family1,hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/301198f682ff4cc78ea889e7e7d5dabb}] 2023-02-13 17:53:51,605 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(763): Validating hfile at hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/301198f682ff4cc78ea889e7e7d5dabb for inclusion in 78541a6966cb9a690d8fb6a7bfe8fd0a/family1 2023-02-13 17:53:51,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-13 17:53:51,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 17:53:51,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegion(2445): Flush status journal for 78541a6966cb9a690d8fb6a7bfe8fd0a: 2023-02-13 17:53:51,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/301198f682ff4cc78ea889e7e7d5dabb to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__l1tvbbqiec59feniusqnmjd6gc6hshk8un3e1rrg9a83dqbeu89r8t9bcmqstd07/family1/301198f682ff4cc78ea889e7e7d5dabb 2023-02-13 17:53:51,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__l1tvbbqiec59feniusqnmjd6gc6hshk8un3e1rrg9a83dqbeu89r8t9bcmqstd07/family1/301198f682ff4cc78ea889e7e7d5dabb as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/ffae175481ed4f1c8f7262027e8faf21_SeqId_44_ 2023-02-13 17:53:51,618 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(849): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__l1tvbbqiec59feniusqnmjd6gc6hshk8un3e1rrg9a83dqbeu89r8t9bcmqstd07/family1/301198f682ff4cc78ea889e7e7d5dabb into 78541a6966cb9a690d8fb6a7bfe8fd0a/family1 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/ffae175481ed4f1c8f7262027e8faf21_SeqId_44_ - updating store file list. 2023-02-13 17:53:51,625 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(882): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/ffae175481ed4f1c8f7262027e8faf21_SeqId_44_ into 78541a6966cb9a690d8fb6a7bfe8fd0a/family1 2023-02-13 17:53:51,625 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(855): Successfully loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__l1tvbbqiec59feniusqnmjd6gc6hshk8un3e1rrg9a83dqbeu89r8t9bcmqstd07/family1/301198f682ff4cc78ea889e7e7d5dabb into 78541a6966cb9a690d8fb6a7bfe8fd0a/family1 (new location: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/ffae175481ed4f1c8f7262027e8faf21_SeqId_44_) 2023-02-13 17:53:51,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__l1tvbbqiec59feniusqnmjd6gc6hshk8un3e1rrg9a83dqbeu89r8t9bcmqstd07/family1/301198f682ff4cc78ea889e7e7d5dabb 2023-02-13 17:53:51,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-13 17:53:51,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51357 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-13 17:53:51,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(1912): 78541a6966cb9a690d8fb6a7bfe8fd0a/family1 is initiating minor compaction 2023-02-13 17:53:51,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@521732f6; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 17:53:51,638 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 78541a6966cb9a690d8fb6a7bfe8fd0a/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a. 2023-02-13 17:53:51,639 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/7453f5e272b04625967ee3a171adc1b9, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/3f2d4e237e6c400d9ff5b49045cb4484, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/6f7d28aa0d5c44f597bff4961265aa9b, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/0198f59cf22449b6a8c167aa869d84c3, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/b9a2be0e27b2473589f8772c77605b5a, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/6821b8f37697433290703c30838eb6fc, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/c4bcd19a42fc47819b581b1fdc68b3a0, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/f721116528b9480394c401b92098a93a, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/cefa0acd03b440229ca5a828a7389d28, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/ffae175481ed4f1c8f7262027e8faf21_SeqId_44_] into tmpdir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/.tmp, totalSize=50.2 K 2023-02-13 17:53:51,639 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting 7453f5e272b04625967ee3a171adc1b9, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-13 17:53:51,640 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting 3f2d4e237e6c400d9ff5b49045cb4484, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-13 17:53:51,640 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting 6f7d28aa0d5c44f597bff4961265aa9b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-13 17:53:51,640 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting 0198f59cf22449b6a8c167aa869d84c3, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-13 17:53:51,640 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting b9a2be0e27b2473589f8772c77605b5a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-13 17:53:51,640 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting 6821b8f37697433290703c30838eb6fc, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-13 17:53:51,640 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting c4bcd19a42fc47819b581b1fdc68b3a0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-13 17:53:51,640 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting f721116528b9480394c401b92098a93a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-13 17:53:51,640 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting cefa0acd03b440229ca5a828a7389d28, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-13 17:53:51,640 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting ffae175481ed4f1c8f7262027e8faf21_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-13 17:53:51,653 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-13 17:53:51,655 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:53:51,660 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512286ab1ea80d27b497b887058834a09e1b4 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512286ab1ea80d27b497b887058834a09e1b4 2023-02-13 17:53:51,662 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231fadc65d2fe274c8dbacc8443f5c2b777 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231fadc65d2fe274c8dbacc8443f5c2b777 2023-02-13 17:53:51,671 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101fd928b936e5243a0ab5173eaae4d77dc to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101fd928b936e5243a0ab5173eaae4d77dc 2023-02-13 17:53:51,675 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103e01b334a29504fd5892f63903a665498 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103e01b334a29504fd5892f63903a665498 2023-02-13 17:53:51,675 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 4 expired mob files are deleted 2023-02-13 17:53:51,675 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-13 17:53:51,676 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 17:53:51,676 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 17:53:51,676 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 17:53:51,676 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 17:53:51,676 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 17:53:51,676 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 17:53:51,676 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 17:53:51,676 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 17:53:51,702 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] throttle.PressureAwareThroughputController(145): 78541a6966cb9a690d8fb6a7bfe8fd0a#family1#compaction#10 average throughput is 0.36 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 17:53:52,131 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/.tmp/family1/ba6cfd7412264ae4ab2bdab6548670f2 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/ba6cfd7412264ae4ab2bdab6548670f2 2023-02-13 17:53:52,151 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 78541a6966cb9a690d8fb6a7bfe8fd0a/family1 of 78541a6966cb9a690d8fb6a7bfe8fd0a into ba6cfd7412264ae4ab2bdab6548670f2(size=6.6 K), total size for store is 182.5 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 17:53:52,151 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 78541a6966cb9a690d8fb6a7bfe8fd0a: 2023-02-13 17:53:52,153 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a., storeName=family1, fileCount=10, fileSize=50.2 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.5 K), priority=2, time=1676310831636; duration=0sec 2023-02-13 17:53:52,155 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 17:53:52,175 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/7453f5e272b04625967ee3a171adc1b9, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/3f2d4e237e6c400d9ff5b49045cb4484, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/6f7d28aa0d5c44f597bff4961265aa9b, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/0198f59cf22449b6a8c167aa869d84c3, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/b9a2be0e27b2473589f8772c77605b5a, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/6821b8f37697433290703c30838eb6fc, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/c4bcd19a42fc47819b581b1fdc68b3a0, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/f721116528b9480394c401b92098a93a, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/cefa0acd03b440229ca5a828a7389d28, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/ffae175481ed4f1c8f7262027e8faf21_SeqId_44_] to archive 2023-02-13 17:53:52,178 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:53:52,180 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/7453f5e272b04625967ee3a171adc1b9 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/7453f5e272b04625967ee3a171adc1b9 2023-02-13 17:53:52,183 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/3f2d4e237e6c400d9ff5b49045cb4484 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/3f2d4e237e6c400d9ff5b49045cb4484 2023-02-13 17:53:52,185 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/6f7d28aa0d5c44f597bff4961265aa9b to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/6f7d28aa0d5c44f597bff4961265aa9b 2023-02-13 17:53:52,187 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/0198f59cf22449b6a8c167aa869d84c3 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/0198f59cf22449b6a8c167aa869d84c3 2023-02-13 17:53:52,189 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/b9a2be0e27b2473589f8772c77605b5a to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/b9a2be0e27b2473589f8772c77605b5a 2023-02-13 17:53:52,192 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/6821b8f37697433290703c30838eb6fc to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/6821b8f37697433290703c30838eb6fc 2023-02-13 17:53:52,195 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/c4bcd19a42fc47819b581b1fdc68b3a0 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/c4bcd19a42fc47819b581b1fdc68b3a0 2023-02-13 17:53:52,196 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/f721116528b9480394c401b92098a93a to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/f721116528b9480394c401b92098a93a 2023-02-13 17:53:52,198 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/cefa0acd03b440229ca5a828a7389d28 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/cefa0acd03b440229ca5a828a7389d28 2023-02-13 17:53:52,200 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/ffae175481ed4f1c8f7262027e8faf21_SeqId_44_ to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/ffae175481ed4f1c8f7262027e8faf21_SeqId_44_ 2023-02-13 17:53:52,562 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205294d6a6dbdf94011ad6ccca5bef775fe to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205294d6a6dbdf94011ad6ccca5bef775fe 2023-02-13 17:53:52,564 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-13 17:53:52,598 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/60314ba5e61348418d5a9658b00166e3 first=Optional[r00] last=Optional[r2] 2023-02-13 17:53:52,599 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a., hostname=jenkins-hbase4.apache.org,38881,1676310818035, seqNum=2 for row with hfile group [{family1,hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/60314ba5e61348418d5a9658b00166e3}] 2023-02-13 17:53:52,601 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(763): Validating hfile at hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/60314ba5e61348418d5a9658b00166e3 for inclusion in 78541a6966cb9a690d8fb6a7bfe8fd0a/family1 2023-02-13 17:53:52,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-02-13 17:53:52,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 17:53:52,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegion(2445): Flush status journal for 78541a6966cb9a690d8fb6a7bfe8fd0a: 2023-02-13 17:53:52,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/60314ba5e61348418d5a9658b00166e3 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__h47ka9gia4s8re0dtjso6rv1hadpajf4nusnoo87frpu4fv5l4go97fi21judnr5/family1/60314ba5e61348418d5a9658b00166e3 2023-02-13 17:53:52,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__h47ka9gia4s8re0dtjso6rv1hadpajf4nusnoo87frpu4fv5l4go97fi21judnr5/family1/60314ba5e61348418d5a9658b00166e3 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/c9138407e7484e25a029f1bfd5f3a9e6_SeqId_47_ 2023-02-13 17:53:52,612 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(849): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__h47ka9gia4s8re0dtjso6rv1hadpajf4nusnoo87frpu4fv5l4go97fi21judnr5/family1/60314ba5e61348418d5a9658b00166e3 into 78541a6966cb9a690d8fb6a7bfe8fd0a/family1 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/c9138407e7484e25a029f1bfd5f3a9e6_SeqId_47_ - updating store file list. 2023-02-13 17:53:52,619 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(882): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/c9138407e7484e25a029f1bfd5f3a9e6_SeqId_47_ into 78541a6966cb9a690d8fb6a7bfe8fd0a/family1 2023-02-13 17:53:52,619 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(855): Successfully loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__h47ka9gia4s8re0dtjso6rv1hadpajf4nusnoo87frpu4fv5l4go97fi21judnr5/family1/60314ba5e61348418d5a9658b00166e3 into 78541a6966cb9a690d8fb6a7bfe8fd0a/family1 (new location: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/c9138407e7484e25a029f1bfd5f3a9e6_SeqId_47_) 2023-02-13 17:53:52,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__h47ka9gia4s8re0dtjso6rv1hadpajf4nusnoo87frpu4fv5l4go97fi21judnr5/family1/60314ba5e61348418d5a9658b00166e3 2023-02-13 17:53:52,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-13 17:53:52,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 367249 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-13 17:53:52,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(1912): 78541a6966cb9a690d8fb6a7bfe8fd0a/family1 is initiating minor compaction (all files) 2023-02-13 17:53:52,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@36af619d; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 17:53:52,622 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 78541a6966cb9a690d8fb6a7bfe8fd0a/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a. 2023-02-13 17:53:52,622 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/263f76ae5c2a42a1ab4a94426278c0f2, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/ba6cfd7412264ae4ab2bdab6548670f2, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/c9138407e7484e25a029f1bfd5f3a9e6_SeqId_47_] into tmpdir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/.tmp, totalSize=358.6 K 2023-02-13 17:53:52,623 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting 263f76ae5c2a42a1ab4a94426278c0f2, keycount=1000, bloomtype=ROW, size=175.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878841551 2023-02-13 17:53:52,624 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting ba6cfd7412264ae4ab2bdab6548670f2, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621241551 2023-02-13 17:53:52,624 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting c9138407e7484e25a029f1bfd5f3a9e6_SeqId_47_, keycount=1002, bloomtype=ROW, size=176.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878841551 2023-02-13 17:53:52,625 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-13 17:53:52,627 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:53:52,629 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130f625f63cc07b42bfb841b6eaf53a1fe1 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130f625f63cc07b42bfb841b6eaf53a1fe1 2023-02-13 17:53:52,631 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201b30c5125375f4b41bfedf042f8f58095 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201b30c5125375f4b41bfedf042f8f58095 2023-02-13 17:53:52,633 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205163ec0944bbd4dee8f3ddf83b3333b28 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205163ec0944bbd4dee8f3ddf83b3333b28 2023-02-13 17:53:52,633 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 3 expired mob files are deleted 2023-02-13 17:53:52,633 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-13 17:53:52,633 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 17:53:52,634 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-13 17:53:52,634 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 17:53:52,635 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=12, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-13 17:53:52,637 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 1.6360 sec 2023-02-13 17:53:52,665 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] throttle.PressureAwareThroughputController(145): 78541a6966cb9a690d8fb6a7bfe8fd0a#family1#compaction#11 average throughput is 6.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 17:53:52,791 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.HMaster$12(2441): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthly from 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-13 17:53:52,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:53,215 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-02-13 17:53:53,216 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-02-13 17:53:53,216 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-02-13 17:53:53,221 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly}] 2023-02-13 17:53:53,235 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=78541a6966cb9a690d8fb6a7bfe8fd0a, REOPEN/MOVE}] 2023-02-13 17:53:53,236 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=78541a6966cb9a690d8fb6a7bfe8fd0a, REOPEN/MOVE 2023-02-13 17:53:53,236 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=78541a6966cb9a690d8fb6a7bfe8fd0a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:53,237 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676310833236"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676310833236"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676310833236"}]},"ts":"1676310833236"} 2023-02-13 17:53:53,239 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE; CloseRegionProcedure 78541a6966cb9a690d8fb6a7bfe8fd0a, server=jenkins-hbase4.apache.org,38881,1676310818035}] 2023-02-13 17:53:53,397 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 78541a6966cb9a690d8fb6a7bfe8fd0a 2023-02-13 17:53:53,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 78541a6966cb9a690d8fb6a7bfe8fd0a, disabling compactions & flushes 2023-02-13 17:53:53,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1857): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a. 2023-02-13 17:53:53,901 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/.tmp/family1/0384541b1c6247b3891d48930fd9cdbf as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/0384541b1c6247b3891d48930fd9cdbf 2023-02-13 17:53:53,909 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 78541a6966cb9a690d8fb6a7bfe8fd0a/family1 of 78541a6966cb9a690d8fb6a7bfe8fd0a into 0384541b1c6247b3891d48930fd9cdbf(size=177.2 K), total size for store is 177.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 17:53:53,909 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 78541a6966cb9a690d8fb6a7bfe8fd0a: 2023-02-13 17:53:53,909 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a. 2023-02-13 17:53:53,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a. 2023-02-13 17:53:53,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a. after waiting 0 ms 2023-02-13 17:53:53,909 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a., storeName=family1, fileCount=3, fileSize=358.6 K (175.8 K, 6.6 K, 176.2 K), priority=2, time=1676310832621; duration=1sec 2023-02-13 17:53:53,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a. 2023-02-13 17:53:53,909 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 17:53:53,913 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/263f76ae5c2a42a1ab4a94426278c0f2, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/ba6cfd7412264ae4ab2bdab6548670f2, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/c9138407e7484e25a029f1bfd5f3a9e6_SeqId_47_] to archive 2023-02-13 17:53:53,914 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:53:53,916 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/263f76ae5c2a42a1ab4a94426278c0f2 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/263f76ae5c2a42a1ab4a94426278c0f2 2023-02-13 17:53:53,917 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/ba6cfd7412264ae4ab2bdab6548670f2 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/ba6cfd7412264ae4ab2bdab6548670f2 2023-02-13 17:53:53,919 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/c9138407e7484e25a029f1bfd5f3a9e6_SeqId_47_ to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/c9138407e7484e25a029f1bfd5f3a9e6_SeqId_47_ 2023-02-13 17:53:53,925 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-13 17:53:53,926 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a. 2023-02-13 17:53:53,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 78541a6966cb9a690d8fb6a7bfe8fd0a: Waiting for close lock at 1676310833398Running coprocessor pre-close hooks at 1676310833398Disabling compacts and flushes for region at 1676310833398Disabling writes for close at 1676310833909 (+511 ms)Writing region close event to WAL at 1676310833921 (+12 ms)Running coprocessor post-close hooks at 1676310833925 (+4 ms)Closed at 1676310833926 (+1 ms) 2023-02-13 17:53:53,926 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 78541a6966cb9a690d8fb6a7bfe8fd0a to self. 2023-02-13 17:53:53,928 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 78541a6966cb9a690d8fb6a7bfe8fd0a 2023-02-13 17:53:53,929 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=78541a6966cb9a690d8fb6a7bfe8fd0a, regionState=CLOSED 2023-02-13 17:53:53,929 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676310833929"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676310833929"}]},"ts":"1676310833929"} 2023-02-13 17:53:53,933 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-13 17:53:53,933 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; CloseRegionProcedure 78541a6966cb9a690d8fb6a7bfe8fd0a, server=jenkins-hbase4.apache.org,38881,1676310818035 in 692 msec 2023-02-13 17:53:53,934 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=78541a6966cb9a690d8fb6a7bfe8fd0a, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,38881,1676310818035; forceNewPlan=false, retain=true 2023-02-13 17:53:54,084 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=78541a6966cb9a690d8fb6a7bfe8fd0a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:54,085 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676310834084"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676310834084"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676310834084"}]},"ts":"1676310834084"} 2023-02-13 17:53:54,087 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure 78541a6966cb9a690d8fb6a7bfe8fd0a, server=jenkins-hbase4.apache.org,38881,1676310818035}] 2023-02-13 17:53:54,243 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a. 2023-02-13 17:53:54,243 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 78541a6966cb9a690d8fb6a7bfe8fd0a, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a.', STARTKEY => '', ENDKEY => ''} 2023-02-13 17:53:54,243 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 78541a6966cb9a690d8fb6a7bfe8fd0a 2023-02-13 17:53:54,243 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 17:53:54,243 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 78541a6966cb9a690d8fb6a7bfe8fd0a 2023-02-13 17:53:54,243 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 78541a6966cb9a690d8fb6a7bfe8fd0a 2023-02-13 17:53:54,245 INFO [StoreOpener-78541a6966cb9a690d8fb6a7bfe8fd0a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 78541a6966cb9a690d8fb6a7bfe8fd0a 2023-02-13 17:53:54,246 DEBUG [StoreOpener-78541a6966cb9a690d8fb6a7bfe8fd0a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1 2023-02-13 17:53:54,246 DEBUG [StoreOpener-78541a6966cb9a690d8fb6a7bfe8fd0a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1 2023-02-13 17:53:54,247 INFO [StoreOpener-78541a6966cb9a690d8fb6a7bfe8fd0a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 78541a6966cb9a690d8fb6a7bfe8fd0a columnFamilyName family1 2023-02-13 17:53:54,254 DEBUG [StoreOpener-78541a6966cb9a690d8fb6a7bfe8fd0a-1] regionserver.HStore(539): loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/0384541b1c6247b3891d48930fd9cdbf 2023-02-13 17:53:54,254 INFO [StoreOpener-78541a6966cb9a690d8fb6a7bfe8fd0a-1] regionserver.HStore(310): Store=78541a6966cb9a690d8fb6a7bfe8fd0a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 17:53:54,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a 2023-02-13 17:53:54,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a 2023-02-13 17:53:54,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 78541a6966cb9a690d8fb6a7bfe8fd0a 2023-02-13 17:53:54,261 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 78541a6966cb9a690d8fb6a7bfe8fd0a; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59260606, jitterRate=-0.11694815754890442}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 17:53:54,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 78541a6966cb9a690d8fb6a7bfe8fd0a: Running coprocessor pre-open hook at 1676310834244Writing region info on filesystem at 1676310834244Initializing all the Stores at 1676310834245 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1676310834245Cleaning up temporary data from old regions at 1676310834257 (+12 ms)Cleaning up detritus from prior splits at 1676310834258 (+1 ms)Running coprocessor post-open hooks at 1676310834261 (+3 ms)Region opened successfully at 1676310834261 2023-02-13 17:53:54,262 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a., pid=17, masterSystemTime=1676310834239 2023-02-13 17:53:54,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a. 2023-02-13 17:53:54,264 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a. 2023-02-13 17:53:54,265 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=78541a6966cb9a690d8fb6a7bfe8fd0a, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:54,265 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676310834264"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676310834264"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676310834264"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676310834264"}]},"ts":"1676310834264"} 2023-02-13 17:53:54,269 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=15 2023-02-13 17:53:54,269 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure 78541a6966cb9a690d8fb6a7bfe8fd0a, server=jenkins-hbase4.apache.org,38881,1676310818035 in 180 msec 2023-02-13 17:53:54,271 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-02-13 17:53:54,271 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=78541a6966cb9a690d8fb6a7bfe8fd0a, REOPEN/MOVE in 1.0340 sec 2023-02-13 17:53:54,274 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=13 2023-02-13 17:53:54,274 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=13, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.0520 sec 2023-02-13 17:53:54,277 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.4810 sec 2023-02-13 17:53:54,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=13 2023-02-13 17:53:54,286 INFO [Listener at localhost/35343] compactions.TestMobCompactor(278): alter status finished 2023-02-13 17:53:54,287 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41433] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 17:53:54,289 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-13 17:53:54,290 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-13 17:53:54,291 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 17:53:54,291 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676311434291 2023-02-13 17:53:54,292 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-13 17:53:54,293 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-02-13 17:53:54,293 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-13 17:53:54,293 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] zookeeper.ReadOnlyZKClient(139): Connect 0x15f2ae72 to 127.0.0.1:64825 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 17:53:54,299 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@523dc664, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 17:53:54,299 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 17:53:54,300 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 17:53:54,300 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 17:53:54,300 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 17:53:54,300 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 17:53:55,134 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128e1577fe9410347959833b74189f8cb5b to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128e1577fe9410347959833b74189f8cb5b 2023-02-13 17:53:55,136 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-13 17:53:55,148 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 17:53:55,149 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45978, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 17:53:55,158 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 17:53:55,159 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35664, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 17:53:55,171 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/12b9f33252774cd2b6785576a4ba6ed7 first=Optional[r05] last=Optional[r8] 2023-02-13 17:53:55,172 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a., hostname=jenkins-hbase4.apache.org,38881,1676310818035, seqNum=51 for row with hfile group [{family1,hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/12b9f33252774cd2b6785576a4ba6ed7}] 2023-02-13 17:53:55,177 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(763): Validating hfile at hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/12b9f33252774cd2b6785576a4ba6ed7 for inclusion in 78541a6966cb9a690d8fb6a7bfe8fd0a/family1 2023-02-13 17:53:55,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-02-13 17:53:55,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 17:53:55,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegion(2445): Flush status journal for 78541a6966cb9a690d8fb6a7bfe8fd0a: 2023-02-13 17:53:55,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/12b9f33252774cd2b6785576a4ba6ed7 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__pm22mnehh9rs6luv2146bpad0mqjdrofhjvv51fdu9dbckk5hprqe0s5eokak06o/family1/12b9f33252774cd2b6785576a4ba6ed7 2023-02-13 17:53:55,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__pm22mnehh9rs6luv2146bpad0mqjdrofhjvv51fdu9dbckk5hprqe0s5eokak06o/family1/12b9f33252774cd2b6785576a4ba6ed7 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/e4ffb552a3444f4c9bfa1f85412b7d7b_SeqId_53_ 2023-02-13 17:53:55,186 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(849): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__pm22mnehh9rs6luv2146bpad0mqjdrofhjvv51fdu9dbckk5hprqe0s5eokak06o/family1/12b9f33252774cd2b6785576a4ba6ed7 into 78541a6966cb9a690d8fb6a7bfe8fd0a/family1 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/e4ffb552a3444f4c9bfa1f85412b7d7b_SeqId_53_ - updating store file list. 2023-02-13 17:53:55,192 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(882): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/e4ffb552a3444f4c9bfa1f85412b7d7b_SeqId_53_ into 78541a6966cb9a690d8fb6a7bfe8fd0a/family1 2023-02-13 17:53:55,192 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(855): Successfully loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__pm22mnehh9rs6luv2146bpad0mqjdrofhjvv51fdu9dbckk5hprqe0s5eokak06o/family1/12b9f33252774cd2b6785576a4ba6ed7 into 78541a6966cb9a690d8fb6a7bfe8fd0a/family1 (new location: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/family1/e4ffb552a3444f4c9bfa1f85412b7d7b_SeqId_53_) 2023-02-13 17:53:55,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__pm22mnehh9rs6luv2146bpad0mqjdrofhjvv51fdu9dbckk5hprqe0s5eokak06o/family1/12b9f33252774cd2b6785576a4ba6ed7 2023-02-13 17:53:55,195 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-13 17:53:55,196 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:53:55,197 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151120864f52c28bb44139ac87b519288a860c to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151120864f52c28bb44139ac87b519288a860c 2023-02-13 17:53:55,199 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511280a35a943043b45008d364d0caafe4221 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511280a35a943043b45008d364d0caafe4221 2023-02-13 17:53:55,199 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 2 expired mob files are deleted 2023-02-13 17:53:55,199 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-13 17:53:55,200 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 17:53:55,200 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 17:53:55,200 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 17:53:55,200 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-13 17:53:55,200 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 17:53:55,201 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-13 17:53:55,203 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 913 msec 2023-02-13 17:53:55,293 INFO [Listener at localhost/35343] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=247 (was 209) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1888498606_15 at /127.0.0.1:53494 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1888498606_15 at /127.0.0.1:53548 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64825@0x15f2ae72-SendThread(127.0.0.1:64825) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1888498606_15 at /127.0.0.1:53460 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: (jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RSProcedureDispatcher-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4975b9d3-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1888498606_15 at /127.0.0.1:53626 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1888498606_15 at /127.0.0.1:53680 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1033540925_15 at /127.0.0.1:53694 [Waiting for operation #19] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64825@0x7c3569a1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/849799958.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1888498606_15 at /127.0.0.1:53738 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5e32497c-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5e32497c-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64825@0x15f2ae72-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1888498606_15 at /127.0.0.1:53566 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64825@0x15f2ae72 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/849799958.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobCompactor-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1888498606_15 at /127.0.0.1:53582 [Waiting for operation #22] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1888498606_15 at /127.0.0.1:53624 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b2e1a147-a5e4-cd2d-85aa-2dcb3ac8be25/cluster_42c07e65-ff5f-a75e-a69f-8f3d2a010de7/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1888498606_15 at /127.0.0.1:53650 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1888498606_15 at /127.0.0.1:53636 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1888498606_15 at /127.0.0.1:53728 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS:0;jenkins-hbase4:38881-shortCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64825@0x7c3569a1-SendThread(127.0.0.1:64825) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1888498606_15 at /127.0.0.1:53516 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4975b9d3-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5e32497c-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1888498606_15 at /127.0.0.1:53558 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64825@0x7c3569a1-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1888498606_15 at /127.0.0.1:53622 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=599 (was 475) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=336 (was 412), ProcessCount=168 (was 168), AvailableMemoryMB=1248 (was 1524) 2023-02-13 17:53:55,313 INFO [Listener at localhost/35343] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=247, OpenFileDescriptor=599, MaxFileDescriptor=60000, SystemLoadAverage=336, ProcessCount=168, AvailableMemoryMB=1247 2023-02-13 17:53:55,316 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-13 17:53:55,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:55,319 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 17:53:55,319 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithMonthlyPolicy" procId is: 19 2023-02-13 17:53:55,320 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 17:53:55,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-13 17:53:55,324 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810 2023-02-13 17:53:55,325 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810 empty. 2023-02-13 17:53:55,325 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810 2023-02-13 17:53:55,325 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithMonthlyPolicy regions 2023-02-13 17:53:55,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-13 17:53:55,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-13 17:53:55,742 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-02-13 17:53:55,743 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7671): creating {ENCODED => 0cfde756752436e731853466f9c70810, NAME => 'testMajorCompactionWithMonthlyPolicy,,1676310835316.0cfde756752436e731853466f9c70810.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp 2023-02-13 17:53:55,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-13 17:53:56,151 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithMonthlyPolicy,,1676310835316.0cfde756752436e731853466f9c70810.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 17:53:56,151 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1603): Closing 0cfde756752436e731853466f9c70810, disabling compactions & flushes 2023-02-13 17:53:56,151 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithMonthlyPolicy,,1676310835316.0cfde756752436e731853466f9c70810. 2023-02-13 17:53:56,151 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1676310835316.0cfde756752436e731853466f9c70810. 2023-02-13 17:53:56,151 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1676310835316.0cfde756752436e731853466f9c70810. after waiting 0 ms 2023-02-13 17:53:56,151 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1676310835316.0cfde756752436e731853466f9c70810. 2023-02-13 17:53:56,151 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithMonthlyPolicy,,1676310835316.0cfde756752436e731853466f9c70810. 2023-02-13 17:53:56,151 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1557): Region close journal for 0cfde756752436e731853466f9c70810: Waiting for close lock at 1676310836151Disabling compacts and flushes for region at 1676310836151Disabling writes for close at 1676310836151Writing region close event to WAL at 1676310836151Closed at 1676310836151 2023-02-13 17:53:56,154 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 17:53:56,155 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithMonthlyPolicy,,1676310835316.0cfde756752436e731853466f9c70810.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676310836155"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676310836155"}]},"ts":"1676310836155"} 2023-02-13 17:53:56,157 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 17:53:56,158 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 17:53:56,158 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676310836158"}]},"ts":"1676310836158"} 2023-02-13 17:53:56,160 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-02-13 17:53:56,163 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=0cfde756752436e731853466f9c70810, ASSIGN}] 2023-02-13 17:53:56,164 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=0cfde756752436e731853466f9c70810, ASSIGN 2023-02-13 17:53:56,165 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=0cfde756752436e731853466f9c70810, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38881,1676310818035; forceNewPlan=false, retain=false 2023-02-13 17:53:56,316 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=0cfde756752436e731853466f9c70810, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:56,316 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithMonthlyPolicy,,1676310835316.0cfde756752436e731853466f9c70810.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676310836316"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676310836316"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676310836316"}]},"ts":"1676310836316"} 2023-02-13 17:53:56,319 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure 0cfde756752436e731853466f9c70810, server=jenkins-hbase4.apache.org,38881,1676310818035}] 2023-02-13 17:53:56,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-13 17:53:56,475 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithMonthlyPolicy,,1676310835316.0cfde756752436e731853466f9c70810. 2023-02-13 17:53:56,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 0cfde756752436e731853466f9c70810, NAME => 'testMajorCompactionWithMonthlyPolicy,,1676310835316.0cfde756752436e731853466f9c70810.', STARTKEY => '', ENDKEY => ''} 2023-02-13 17:53:56,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithMonthlyPolicy 0cfde756752436e731853466f9c70810 2023-02-13 17:53:56,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithMonthlyPolicy,,1676310835316.0cfde756752436e731853466f9c70810.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 17:53:56,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 0cfde756752436e731853466f9c70810 2023-02-13 17:53:56,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 0cfde756752436e731853466f9c70810 2023-02-13 17:53:56,477 INFO [StoreOpener-0cfde756752436e731853466f9c70810-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 0cfde756752436e731853466f9c70810 2023-02-13 17:53:56,479 DEBUG [StoreOpener-0cfde756752436e731853466f9c70810-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1 2023-02-13 17:53:56,479 DEBUG [StoreOpener-0cfde756752436e731853466f9c70810-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1 2023-02-13 17:53:56,480 INFO [StoreOpener-0cfde756752436e731853466f9c70810-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0cfde756752436e731853466f9c70810 columnFamilyName family1 2023-02-13 17:53:56,486 INFO [StoreOpener-0cfde756752436e731853466f9c70810-1] regionserver.HStore(310): Store=0cfde756752436e731853466f9c70810/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 17:53:56,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810 2023-02-13 17:53:56,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810 2023-02-13 17:53:56,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 0cfde756752436e731853466f9c70810 2023-02-13 17:53:56,495 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 17:53:56,495 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 0cfde756752436e731853466f9c70810; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72899397, jitterRate=0.08628566563129425}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 17:53:56,495 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 0cfde756752436e731853466f9c70810: Running coprocessor pre-open hook at 1676310836476Writing region info on filesystem at 1676310836476Initializing all the Stores at 1676310836477 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1676310836477Cleaning up temporary data from old regions at 1676310836488 (+11 ms)Cleaning up detritus from prior splits at 1676310836488Running coprocessor post-open hooks at 1676310836495 (+7 ms)Region opened successfully at 1676310836495 2023-02-13 17:53:56,497 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithMonthlyPolicy,,1676310835316.0cfde756752436e731853466f9c70810., pid=21, masterSystemTime=1676310836471 2023-02-13 17:53:56,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithMonthlyPolicy,,1676310835316.0cfde756752436e731853466f9c70810. 2023-02-13 17:53:56,499 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithMonthlyPolicy,,1676310835316.0cfde756752436e731853466f9c70810. 2023-02-13 17:53:56,500 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=0cfde756752436e731853466f9c70810, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:56,500 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithMonthlyPolicy,,1676310835316.0cfde756752436e731853466f9c70810.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676310836500"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676310836500"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676310836500"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676310836500"}]},"ts":"1676310836500"} 2023-02-13 17:53:56,504 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=20 2023-02-13 17:53:56,504 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure 0cfde756752436e731853466f9c70810, server=jenkins-hbase4.apache.org,38881,1676310818035 in 183 msec 2023-02-13 17:53:56,506 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=20, resume processing ppid=19 2023-02-13 17:53:56,507 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=0cfde756752436e731853466f9c70810, ASSIGN in 341 msec 2023-02-13 17:53:56,507 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 17:53:56,508 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676310836507"}]},"ts":"1676310836507"} 2023-02-13 17:53:56,509 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-02-13 17:53:56,512 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 17:53:56,514 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy in 1.1960 sec 2023-02-13 17:53:57,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-13 17:53:57,427 INFO [Listener at localhost/35343] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithMonthlyPolicy, procId: 19 completed 2023-02-13 17:53:57,466 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:53:57,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:57,468 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 17:53:57,468 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:53:57,469 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 17:53:57,469 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 17:53:57,469 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:57,469 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:57,471 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:57,471 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:53:57,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:53:57,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:53:57,471 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:57,471 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:53:57,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:57,472 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:57,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:53:57,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:57,472 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:57,473 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:57,473 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 17:53:57,473 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:53:57,473 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 17:53:57,473 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:53:57,473 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:53:57,473 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676310835316.0cfde756752436e731853466f9c70810. 2023-02-13 17:53:57,474 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676310835316.0cfde756752436e731853466f9c70810. started... 2023-02-13 17:53:57,474 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 0cfde756752436e731853466f9c70810 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-13 17:53:57,755 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 17:53:57,902 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113034994c47509943c7b3da2cec130b73b0 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015113034994c47509943c7b3da2cec130b73b0 2023-02-13 17:53:58,306 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/.tmp/family1/233d809951f34f8bb4495dc06509ce51 2023-02-13 17:53:58,313 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/.tmp/family1/233d809951f34f8bb4495dc06509ce51 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/233d809951f34f8bb4495dc06509ce51 2023-02-13 17:53:58,319 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/233d809951f34f8bb4495dc06509ce51, entries=1000, sequenceid=5, filesize=166.0 K 2023-02-13 17:53:58,320 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 0cfde756752436e731853466f9c70810 in 846ms, sequenceid=5, compaction requested=false 2023-02-13 17:53:58,320 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 0cfde756752436e731853466f9c70810: 2023-02-13 17:53:58,321 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676310835316.0cfde756752436e731853466f9c70810. 2023-02-13 17:53:58,321 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:53:58,321 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:53:58,321 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:58,321 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 17:53:58,321 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-13 17:53:58,322 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:58,322 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:58,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:58,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:53:58,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:53:58,323 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:58,323 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:53:58,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:53:58,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:53:58,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:58,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:58,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:53:58,324 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 17:53:58,324 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@461ce35c[Count = 0] remaining members to acquire global barrier 2023-02-13 17:53:58,324 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 17:53:58,324 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:58,327 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:58,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:58,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:58,327 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 17:53:58,327 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-13 17:53:58,327 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:53:58,327 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:58,327 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:53:58,328 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:58,328 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 17:53:58,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:58,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:53:58,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:53:58,328 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:53:58,329 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-13 17:53:58,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:53:58,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:53:58,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:58,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:58,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:53:58,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:58,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:58,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:53:58,331 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 17:53:58,331 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-13 17:53:58,331 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:53:58,332 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:53:58,332 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:58,332 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:53:58,333 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:58,333 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:58,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:58,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:58,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:53:58,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:53:58,333 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:53:58,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:58,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:53:58,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:53:58,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:53:58,334 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:58,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:58,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:58,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:53:58,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:58,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:58,335 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:58,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:53:58,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:58,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:58,338 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:58,338 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:53:58,338 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:58,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:53:58,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:53:58,338 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 17:53:58,338 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:53:58,338 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:53:58,338 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:53:58,338 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:58,339 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:58,339 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:58,339 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:58,339 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 17:53:58,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:53:58,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:53:58,339 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:53:58,339 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:58,439 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:53:58,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:53:58,446 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:53:58,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 17:53:58,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:58,448 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 17:53:58,448 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:53:58,448 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 17:53:58,448 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 17:53:58,449 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:58,449 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:58,456 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:58,456 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:53:58,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:53:58,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:53:58,456 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:58,456 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:53:58,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:58,457 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:58,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:53:58,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:58,457 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:58,457 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 17:53:58,457 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:58,458 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 17:53:58,458 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:53:58,458 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 17:53:58,458 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:53:58,458 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:53:58,458 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676310835316.0cfde756752436e731853466f9c70810. 2023-02-13 17:53:58,458 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676310835316.0cfde756752436e731853466f9c70810. started... 2023-02-13 17:53:58,458 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 0cfde756752436e731853466f9c70810 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-13 17:53:58,875 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128e9329db0769c475cb12193b5d8f8e275 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128e9329db0769c475cb12193b5d8f8e275 2023-02-13 17:53:59,281 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/.tmp/family1/8d66c220406148549aec8462e0bc6aca 2023-02-13 17:53:59,288 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/.tmp/family1/8d66c220406148549aec8462e0bc6aca as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/8d66c220406148549aec8462e0bc6aca 2023-02-13 17:53:59,293 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/8d66c220406148549aec8462e0bc6aca, entries=1, sequenceid=9, filesize=5.0 K 2023-02-13 17:53:59,294 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 0cfde756752436e731853466f9c70810 in 836ms, sequenceid=9, compaction requested=false 2023-02-13 17:53:59,294 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 0cfde756752436e731853466f9c70810: 2023-02-13 17:53:59,294 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676310835316.0cfde756752436e731853466f9c70810. 2023-02-13 17:53:59,294 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:53:59,294 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:53:59,294 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:59,294 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 17:53:59,294 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-13 17:53:59,296 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:59,296 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:59,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:59,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:53:59,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:53:59,296 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:59,296 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:53:59,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:53:59,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:53:59,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:59,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:59,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:53:59,298 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 17:53:59,298 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f14e2c3[Count = 0] remaining members to acquire global barrier 2023-02-13 17:53:59,298 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 17:53:59,298 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:59,299 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:59,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:59,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:59,299 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 17:53:59,300 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-13 17:53:59,300 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:59,300 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:53:59,300 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:53:59,302 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 17:53:59,302 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:59,302 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:53:59,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:59,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:53:59,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:53:59,302 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-13 17:53:59,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:53:59,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:53:59,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:59,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:59,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:53:59,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:59,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:59,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:53:59,305 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 17:53:59,305 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-13 17:53:59,306 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:53:59,306 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:53:59,306 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:59,306 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:53:59,307 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:59,307 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:59,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:59,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:53:59,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:53:59,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:59,308 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:53:59,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:59,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:53:59,308 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:59,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:53:59,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:53:59,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:59,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:59,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:53:59,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:59,309 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:59,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:59,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:53:59,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:59,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:59,320 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:59,320 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:53:59,320 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:59,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:53:59,320 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:53:59,320 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 17:53:59,320 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 17:53:59,321 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:53:59,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:53:59,320 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:59,320 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:53:59,321 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:59,321 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:59,321 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:59,321 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 17:53:59,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:53:59,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:53:59,321 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:59,321 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:53:59,422 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:53:59,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:53:59,427 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:53:59,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 17:53:59,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:59,429 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 17:53:59,429 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:53:59,430 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 17:53:59,430 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 17:53:59,430 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:59,430 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:59,432 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:59,432 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:53:59,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:53:59,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:53:59,432 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:53:59,432 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:53:59,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:59,433 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:59,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:53:59,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:59,433 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:59,433 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 17:53:59,433 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-13 17:53:59,433 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 17:53:59,433 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:53:59,434 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 17:53:59,434 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:53:59,434 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:53:59,434 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676310835316.0cfde756752436e731853466f9c70810. 2023-02-13 17:53:59,434 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676310835316.0cfde756752436e731853466f9c70810. started... 2023-02-13 17:53:59,434 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 0cfde756752436e731853466f9c70810 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 17:53:59,455 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 17:53:59,851 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512015a8027d4ab294b6ca3aaafb31c486527 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512015a8027d4ab294b6ca3aaafb31c486527 2023-02-13 17:54:00,258 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/.tmp/family1/9bef69aa57034abc8dddb4005556b930 2023-02-13 17:54:00,265 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/.tmp/family1/9bef69aa57034abc8dddb4005556b930 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/9bef69aa57034abc8dddb4005556b930 2023-02-13 17:54:00,271 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/9bef69aa57034abc8dddb4005556b930, entries=1, sequenceid=13, filesize=4.9 K 2023-02-13 17:54:00,272 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0cfde756752436e731853466f9c70810 in 838ms, sequenceid=13, compaction requested=true 2023-02-13 17:54:00,272 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 0cfde756752436e731853466f9c70810: 2023-02-13 17:54:00,272 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676310835316.0cfde756752436e731853466f9c70810. 2023-02-13 17:54:00,272 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:54:00,272 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:54:00,272 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:00,272 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 17:54:00,272 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-13 17:54:00,274 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:00,274 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:00,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:00,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:00,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:00,274 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:00,274 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:54:00,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:00,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:00,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:00,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:00,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:00,276 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 17:54:00,276 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a886474[Count = 0] remaining members to acquire global barrier 2023-02-13 17:54:00,276 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 17:54:00,276 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:00,278 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:00,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:00,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:00,278 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 17:54:00,278 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-13 17:54:00,278 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:54:00,278 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:00,278 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:54:00,280 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 17:54:00,280 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:00,280 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:00,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:00,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:00,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:00,280 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-13 17:54:00,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:00,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:00,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:00,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:00,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:00,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:00,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:00,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:54:00,284 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 17:54:00,284 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-13 17:54:00,284 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:54:00,284 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:54:00,284 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:00,284 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:54:00,286 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:00,286 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:00,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:00,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:00,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:00,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:00,286 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:00,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:00,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:00,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:00,288 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:00,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:00,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:00,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:00,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:00,289 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:00,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:00,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:00,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:00,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:00,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:00,292 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:00,292 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:00,292 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:00,292 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:00,292 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:00,292 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 17:54:00,293 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:54:00,292 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:00,293 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:00,293 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:00,293 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:00,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:00,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:00,294 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 17:54:00,294 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:54:00,294 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:00,294 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 17:54:00,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:00,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:00,394 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:54:00,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:54:00,400 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:54:00,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 17:54:00,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:00,402 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 17:54:00,402 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:00,403 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 17:54:00,403 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 17:54:00,404 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:00,404 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:00,406 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:00,406 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:00,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:00,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:00,407 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:00,407 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:54:00,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:00,407 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:00,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:54:00,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:00,408 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:00,408 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 17:54:00,408 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:00,408 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 17:54:00,408 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:00,409 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 17:54:00,415 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:54:00,415 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:54:00,415 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676310835316.0cfde756752436e731853466f9c70810. 2023-02-13 17:54:00,415 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676310835316.0cfde756752436e731853466f9c70810. started... 2023-02-13 17:54:00,416 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 0cfde756752436e731853466f9c70810 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 17:54:00,832 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205bb300cd0f132426680257480ce7cb64f to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205bb300cd0f132426680257480ce7cb64f 2023-02-13 17:54:01,239 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/.tmp/family1/1e7cecf3375345c8bc73e65cfd8eb352 2023-02-13 17:54:01,247 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/.tmp/family1/1e7cecf3375345c8bc73e65cfd8eb352 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/1e7cecf3375345c8bc73e65cfd8eb352 2023-02-13 17:54:01,254 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/1e7cecf3375345c8bc73e65cfd8eb352, entries=1, sequenceid=17, filesize=4.9 K 2023-02-13 17:54:01,255 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0cfde756752436e731853466f9c70810 in 839ms, sequenceid=17, compaction requested=true 2023-02-13 17:54:01,255 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 0cfde756752436e731853466f9c70810: 2023-02-13 17:54:01,255 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676310835316.0cfde756752436e731853466f9c70810. 2023-02-13 17:54:01,255 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:54:01,255 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:54:01,255 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:01,255 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 17:54:01,255 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-13 17:54:01,257 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:01,257 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:01,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:01,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:01,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:01,257 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:01,257 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:54:01,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:01,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:01,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:01,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:01,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:01,259 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 17:54:01,259 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@29004f82[Count = 0] remaining members to acquire global barrier 2023-02-13 17:54:01,259 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 17:54:01,259 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:01,260 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:01,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:01,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:01,260 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 17:54:01,260 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-13 17:54:01,260 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:01,261 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:54:01,261 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:54:01,262 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 17:54:01,262 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:01,262 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:01,262 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-13 17:54:01,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:01,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:01,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:01,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:01,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:01,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:01,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:01,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:01,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:01,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:01,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:54:01,266 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 17:54:01,266 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-13 17:54:01,266 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:54:01,266 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:54:01,266 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:01,266 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:54:01,269 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:01,269 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:01,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:01,269 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:01,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:01,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:01,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:01,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:01,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:01,269 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:01,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:01,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:01,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:01,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:01,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:01,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:01,271 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:01,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:01,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:01,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:01,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:01,273 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:01,273 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:01,273 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:01,273 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:01,273 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:01,273 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:01,273 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:01,273 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:01,273 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:01,273 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:01,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:01,274 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 17:54:01,274 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 17:54:01,274 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:54:01,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:01,274 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 17:54:01,274 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:54:01,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:01,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:01,374 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:54:01,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:54:01,380 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:54:01,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 17:54:01,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:01,382 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 17:54:01,382 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:01,383 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 17:54:01,383 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 17:54:01,384 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:01,384 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:01,385 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:01,385 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:01,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:01,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:01,385 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:01,385 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:54:01,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:01,386 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:01,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:54:01,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:01,386 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:01,386 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 17:54:01,386 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:01,387 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 17:54:01,387 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:01,387 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 17:54:01,387 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:54:01,387 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:54:01,387 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676310835316.0cfde756752436e731853466f9c70810. 2023-02-13 17:54:01,388 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676310835316.0cfde756752436e731853466f9c70810. started... 2023-02-13 17:54:01,388 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 0cfde756752436e731853466f9c70810 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 17:54:01,810 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122890b7a4316b0d4dc2af52192bcd8a9dd7 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015122890b7a4316b0d4dc2af52192bcd8a9dd7 2023-02-13 17:54:01,824 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/.tmp/family1/401f0ca67c264a9a9eabb26594ecbcc0 2023-02-13 17:54:01,832 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/.tmp/family1/401f0ca67c264a9a9eabb26594ecbcc0 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/401f0ca67c264a9a9eabb26594ecbcc0 2023-02-13 17:54:01,839 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/401f0ca67c264a9a9eabb26594ecbcc0, entries=1, sequenceid=21, filesize=4.9 K 2023-02-13 17:54:01,840 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0cfde756752436e731853466f9c70810 in 452ms, sequenceid=21, compaction requested=true 2023-02-13 17:54:01,841 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 0cfde756752436e731853466f9c70810: 2023-02-13 17:54:01,841 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676310835316.0cfde756752436e731853466f9c70810. 2023-02-13 17:54:01,841 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:54:01,841 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:54:01,841 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:01,841 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 17:54:01,841 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-13 17:54:01,843 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:01,843 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:01,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:01,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:01,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:01,843 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:01,843 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:54:01,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:01,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:01,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:01,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:01,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:01,845 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 17:54:01,845 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@8275ffd[Count = 0] remaining members to acquire global barrier 2023-02-13 17:54:01,845 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 17:54:01,845 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:01,847 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:01,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:01,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:01,847 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 17:54:01,847 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-13 17:54:01,847 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:54:01,848 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:01,848 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:54:01,849 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 17:54:01,849 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:01,849 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:01,849 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-13 17:54:01,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:01,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:01,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:01,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:01,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:01,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:01,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:01,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:01,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:01,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:01,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:54:01,853 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 17:54:01,853 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-13 17:54:01,854 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:54:01,854 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:54:01,854 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:01,854 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:54:01,858 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:01,858 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:01,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:01,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:01,859 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:01,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:01,859 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:01,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:01,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:01,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:01,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:01,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:01,860 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:01,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:01,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:01,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:01,862 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:01,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:01,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:01,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:01,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:01,865 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:01,865 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:01,865 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:01,865 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:01,865 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:01,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:01,865 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:01,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:01,865 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:01,865 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:01,865 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:01,865 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:01,865 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 17:54:01,865 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 17:54:01,866 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:54:01,866 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 17:54:01,867 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:54:01,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:01,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:01,967 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:54:01,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:54:01,973 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:54:01,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 17:54:01,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:01,975 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 17:54:01,975 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:01,976 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 17:54:01,976 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 17:54:01,977 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:01,977 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:01,978 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:01,978 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:01,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:01,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:01,979 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:01,979 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:54:01,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:01,979 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:01,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:54:01,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:01,980 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:01,980 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 17:54:01,980 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:01,980 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 17:54:01,980 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:01,981 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 17:54:01,981 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:54:01,981 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:54:01,981 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676310835316.0cfde756752436e731853466f9c70810. 2023-02-13 17:54:01,981 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676310835316.0cfde756752436e731853466f9c70810. started... 2023-02-13 17:54:01,981 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 0cfde756752436e731853466f9c70810 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 17:54:02,402 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231111af975889a40008287e9bb330bc8a7 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231111af975889a40008287e9bb330bc8a7 2023-02-13 17:54:02,809 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/.tmp/family1/5b68d856ef9f46a3b73df9be14fc663b 2023-02-13 17:54:02,815 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/.tmp/family1/5b68d856ef9f46a3b73df9be14fc663b as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/5b68d856ef9f46a3b73df9be14fc663b 2023-02-13 17:54:02,820 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/5b68d856ef9f46a3b73df9be14fc663b, entries=1, sequenceid=25, filesize=4.9 K 2023-02-13 17:54:02,821 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0cfde756752436e731853466f9c70810 in 840ms, sequenceid=25, compaction requested=true 2023-02-13 17:54:02,822 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 0cfde756752436e731853466f9c70810: 2023-02-13 17:54:02,822 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676310835316.0cfde756752436e731853466f9c70810. 2023-02-13 17:54:02,822 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:54:02,822 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:54:02,822 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:02,822 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 17:54:02,822 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-13 17:54:02,825 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:02,825 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:02,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:02,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:02,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:02,825 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:02,825 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:54:02,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:02,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:02,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:02,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:02,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:02,826 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 17:54:02,826 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@200db6c0[Count = 0] remaining members to acquire global barrier 2023-02-13 17:54:02,826 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 17:54:02,826 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:02,828 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:02,828 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:02,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:02,828 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 17:54:02,828 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-13 17:54:02,828 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:02,828 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:54:02,828 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:54:02,829 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 17:54:02,829 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:02,829 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:02,829 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-13 17:54:02,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:02,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:02,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:02,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:02,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:02,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:02,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:02,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:02,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:02,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:02,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:54:02,832 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 17:54:02,832 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-13 17:54:02,832 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:54:02,832 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:54:02,832 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:02,832 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:54:02,834 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:02,834 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:02,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:02,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:02,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:02,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:02,834 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:02,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:02,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:02,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:02,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:02,834 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:02,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:02,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:02,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:02,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:02,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:02,835 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:02,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:02,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:02,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:02,839 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:02,839 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:02,839 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:02,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:02,839 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:02,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:02,839 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 17:54:02,839 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:54:02,839 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:02,839 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:02,840 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:02,840 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:02,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:02,840 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 17:54:02,840 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:02,840 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:54:02,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:02,840 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:02,940 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:54:02,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:54:02,945 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:54:02,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 17:54:02,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:02,947 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 17:54:02,947 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:02,948 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 17:54:02,948 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 17:54:02,948 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:02,948 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:02,950 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:02,950 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:02,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:02,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:02,950 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:02,950 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:54:02,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:02,950 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:02,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:54:02,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:02,951 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:02,951 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 17:54:02,951 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:02,951 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 17:54:02,951 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:02,952 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 17:54:02,952 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:54:02,952 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:54:02,952 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676310835316.0cfde756752436e731853466f9c70810. 2023-02-13 17:54:02,952 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676310835316.0cfde756752436e731853466f9c70810. started... 2023-02-13 17:54:02,952 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 0cfde756752436e731853466f9c70810 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 17:54:03,368 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101a87bd1ed36cd40a8860f54e9bf8feef4 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101a87bd1ed36cd40a8860f54e9bf8feef4 2023-02-13 17:54:03,774 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/.tmp/family1/3bf0b71c0ac54f93a2c047af990495b5 2023-02-13 17:54:03,780 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/.tmp/family1/3bf0b71c0ac54f93a2c047af990495b5 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/3bf0b71c0ac54f93a2c047af990495b5 2023-02-13 17:54:03,785 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/3bf0b71c0ac54f93a2c047af990495b5, entries=1, sequenceid=29, filesize=4.9 K 2023-02-13 17:54:03,786 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0cfde756752436e731853466f9c70810 in 834ms, sequenceid=29, compaction requested=true 2023-02-13 17:54:03,787 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 0cfde756752436e731853466f9c70810: 2023-02-13 17:54:03,787 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676310835316.0cfde756752436e731853466f9c70810. 2023-02-13 17:54:03,787 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:54:03,787 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:54:03,787 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:03,787 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 17:54:03,787 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-13 17:54:03,789 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:03,789 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:03,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:03,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:03,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:03,789 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:03,789 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:54:03,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:03,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:03,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:03,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:03,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:03,791 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 17:54:03,791 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@393fcd71[Count = 0] remaining members to acquire global barrier 2023-02-13 17:54:03,791 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 17:54:03,791 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:03,792 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:03,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:03,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:03,792 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 17:54:03,792 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:03,792 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:54:03,792 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-13 17:54:03,792 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:54:03,795 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 17:54:03,795 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:03,795 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:03,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:03,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:03,795 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-13 17:54:03,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:03,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:03,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:03,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:03,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:03,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:03,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:03,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:03,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:54:03,798 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 17:54:03,798 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-13 17:54:03,798 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:54:03,798 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:54:03,798 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:03,798 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:54:03,799 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:03,799 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:03,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:03,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:03,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:03,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:03,799 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:03,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:03,800 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:03,800 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:03,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:03,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:03,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:03,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:03,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:03,801 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:03,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:03,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:03,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:03,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:03,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:03,803 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:03,803 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:03,803 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:03,803 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:03,803 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:03,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:03,803 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 17:54:03,804 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:54:03,803 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:03,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:03,804 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 17:54:03,804 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:03,804 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:03,804 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:03,804 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 17:54:03,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:03,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:03,804 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:03,805 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:54:03,905 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:54:03,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:54:03,912 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:54:03,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 17:54:03,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:03,913 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 17:54:03,914 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:03,914 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 17:54:03,914 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 17:54:03,914 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:03,915 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:03,916 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:03,916 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:03,916 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:03,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:03,916 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:03,916 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:54:03,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:03,917 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:03,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:54:03,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:03,917 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:03,917 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 17:54:03,917 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:03,917 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 17:54:03,917 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:03,918 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 17:54:03,918 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:54:03,918 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:54:03,918 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676310835316.0cfde756752436e731853466f9c70810. 2023-02-13 17:54:03,918 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676310835316.0cfde756752436e731853466f9c70810. started... 2023-02-13 17:54:03,918 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 0cfde756752436e731853466f9c70810 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 17:54:04,338 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103d3332fa73a0e4854babcf27584e50f72 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103d3332fa73a0e4854babcf27584e50f72 2023-02-13 17:54:04,744 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/.tmp/family1/9fb3260b6ec54c49b2f0b9290151296c 2023-02-13 17:54:04,750 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/.tmp/family1/9fb3260b6ec54c49b2f0b9290151296c as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/9fb3260b6ec54c49b2f0b9290151296c 2023-02-13 17:54:04,755 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/9fb3260b6ec54c49b2f0b9290151296c, entries=1, sequenceid=33, filesize=4.9 K 2023-02-13 17:54:04,756 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0cfde756752436e731853466f9c70810 in 838ms, sequenceid=33, compaction requested=true 2023-02-13 17:54:04,756 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 0cfde756752436e731853466f9c70810: 2023-02-13 17:54:04,756 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676310835316.0cfde756752436e731853466f9c70810. 2023-02-13 17:54:04,756 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:54:04,756 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:54:04,756 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:04,757 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 17:54:04,757 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-13 17:54:04,759 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:04,759 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:04,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:04,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:04,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:04,760 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:04,760 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:54:04,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:04,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:04,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:04,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:04,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:04,761 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 17:54:04,761 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@12e8e98b[Count = 0] remaining members to acquire global barrier 2023-02-13 17:54:04,761 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 17:54:04,761 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:04,762 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:04,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:04,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:04,762 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 17:54:04,762 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-13 17:54:04,762 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:54:04,762 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:04,763 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:54:04,767 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:04,767 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 17:54:04,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:04,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:04,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:04,767 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:04,767 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-13 17:54:04,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:04,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:04,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:04,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:04,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:04,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:04,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:04,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:54:04,770 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 17:54:04,770 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-13 17:54:04,770 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:54:04,770 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:54:04,770 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:04,770 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:54:04,771 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:04,771 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:04,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:04,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:04,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:04,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:04,771 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:04,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:04,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:04,772 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:04,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:04,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:04,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:04,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:04,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:04,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:04,773 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:04,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:04,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:04,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:04,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:04,775 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:04,775 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:04,775 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:04,775 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:04,775 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:04,775 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 17:54:04,776 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:54:04,775 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 17:54:04,775 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:04,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:04,775 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:04,776 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 17:54:04,776 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:04,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:04,776 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:04,776 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:54:04,776 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:04,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:04,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:04,876 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:54:04,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:54:04,882 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:54:04,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 17:54:04,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:04,885 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 17:54:04,885 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:04,886 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 17:54:04,886 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 17:54:04,886 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:04,886 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:04,887 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:04,887 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:04,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:04,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:04,888 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:04,888 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:54:04,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:04,888 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:04,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:54:04,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:04,889 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:04,889 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 17:54:04,889 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:04,889 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 17:54:04,889 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:04,889 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 17:54:04,890 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:54:04,890 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:54:04,890 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676310835316.0cfde756752436e731853466f9c70810. 2023-02-13 17:54:04,890 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676310835316.0cfde756752436e731853466f9c70810. started... 2023-02-13 17:54:04,890 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 0cfde756752436e731853466f9c70810 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 17:54:05,304 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509073a022529ed194efba2c279854a0bb829 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201509073a022529ed194efba2c279854a0bb829 2023-02-13 17:54:05,310 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/.tmp/family1/e31bcdf5171c496c8dc4a91d1aed613a 2023-02-13 17:54:05,315 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/.tmp/family1/e31bcdf5171c496c8dc4a91d1aed613a as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/e31bcdf5171c496c8dc4a91d1aed613a 2023-02-13 17:54:05,320 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/e31bcdf5171c496c8dc4a91d1aed613a, entries=1, sequenceid=37, filesize=4.9 K 2023-02-13 17:54:05,321 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0cfde756752436e731853466f9c70810 in 431ms, sequenceid=37, compaction requested=true 2023-02-13 17:54:05,322 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 0cfde756752436e731853466f9c70810: 2023-02-13 17:54:05,322 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676310835316.0cfde756752436e731853466f9c70810. 2023-02-13 17:54:05,322 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:54:05,322 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:54:05,322 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:05,322 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 17:54:05,322 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-13 17:54:05,324 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:05,324 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:05,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:05,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:05,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:05,325 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:05,325 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:54:05,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:05,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:05,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:05,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:05,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:05,326 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 17:54:05,326 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2082949c[Count = 0] remaining members to acquire global barrier 2023-02-13 17:54:05,326 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 17:54:05,326 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:05,327 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:05,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:05,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:05,327 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 17:54:05,327 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-13 17:54:05,327 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:54:05,327 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:05,328 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:54:05,329 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 17:54:05,329 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:05,329 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:05,329 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-13 17:54:05,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:05,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:05,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:05,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:05,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:05,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:05,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:05,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:05,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:05,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:05,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:54:05,332 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 17:54:05,332 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-13 17:54:05,332 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:54:05,332 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:54:05,332 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:05,332 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:54:05,334 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:05,334 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:05,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:05,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:05,334 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:05,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:05,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:05,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:05,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:05,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:05,334 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:05,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:05,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:05,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:05,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:05,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:05,335 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:05,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:05,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:05,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:05,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:05,338 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:05,338 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:05,338 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:05,338 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:05,338 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:05,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:05,339 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:05,338 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 17:54:05,339 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:54:05,339 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:05,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:05,339 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:05,339 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 17:54:05,339 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:05,339 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 17:54:05,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:05,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:05,339 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:05,340 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:54:05,440 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:54:05,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:54:05,445 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:54:05,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 17:54:05,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:05,447 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 17:54:05,447 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:05,448 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 17:54:05,448 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 17:54:05,448 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:05,448 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:05,449 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:05,449 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:05,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:05,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:05,450 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:05,450 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:54:05,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:05,450 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:05,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:54:05,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:05,451 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:05,451 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 17:54:05,451 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:05,451 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 17:54:05,451 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:05,452 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 17:54:05,452 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:54:05,452 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:54:05,452 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676310835316.0cfde756752436e731853466f9c70810. 2023-02-13 17:54:05,452 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676310835316.0cfde756752436e731853466f9c70810. started... 2023-02-13 17:54:05,453 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 0cfde756752436e731853466f9c70810 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 17:54:05,867 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112053e8406631cb4b759f4ca57aac74ced2 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112053e8406631cb4b759f4ca57aac74ced2 2023-02-13 17:54:06,273 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/.tmp/family1/3581f66a05e34413852b8ad68f3a2526 2023-02-13 17:54:06,279 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/.tmp/family1/3581f66a05e34413852b8ad68f3a2526 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/3581f66a05e34413852b8ad68f3a2526 2023-02-13 17:54:06,284 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/3581f66a05e34413852b8ad68f3a2526, entries=1, sequenceid=41, filesize=4.9 K 2023-02-13 17:54:06,285 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0cfde756752436e731853466f9c70810 in 832ms, sequenceid=41, compaction requested=true 2023-02-13 17:54:06,285 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 0cfde756752436e731853466f9c70810: 2023-02-13 17:54:06,285 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676310835316.0cfde756752436e731853466f9c70810. 2023-02-13 17:54:06,285 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:54:06,285 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:54:06,285 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:06,285 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 17:54:06,285 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-13 17:54:06,287 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:06,287 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:06,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:06,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:06,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:06,287 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:06,287 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:54:06,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:06,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:06,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:06,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:06,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:06,289 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 17:54:06,289 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6df49dfa[Count = 0] remaining members to acquire global barrier 2023-02-13 17:54:06,289 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 17:54:06,289 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:06,290 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:06,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:06,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:06,290 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 17:54:06,290 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-13 17:54:06,290 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:54:06,290 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:06,290 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:54:06,293 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:06,293 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 17:54:06,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:06,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:06,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:06,293 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:06,293 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-13 17:54:06,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:06,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:06,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:06,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:06,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:06,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:06,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:06,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:54:06,295 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 17:54:06,295 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-13 17:54:06,295 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:54:06,295 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:54:06,295 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:06,295 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:54:06,297 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:06,297 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:06,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:06,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:06,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:06,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:06,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:06,297 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:06,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:06,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:06,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:06,298 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:06,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:06,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:06,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:06,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:06,299 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:06,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:06,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:06,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:06,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:06,301 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:06,301 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:06,301 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:06,301 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:06,301 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 17:54:06,301 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:54:06,301 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:06,301 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 17:54:06,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:06,301 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:06,301 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:06,301 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 17:54:06,302 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:54:06,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:06,301 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:06,303 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:06,303 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:06,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:06,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:06,403 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:54:06,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:54:06,405 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41433] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithMonthlyPolicy 2023-02-13 17:54:06,406 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] procedure2.ProcedureExecutor(1029): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-13 17:54:06,407 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-13 17:54:06,408 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 17:54:06,408 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676311446408 2023-02-13 17:54:06,409 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-13 17:54:06,411 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithMonthlyPolicy' and column 'family1' 2023-02-13 17:54:06,411 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 17:54:06,411 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] zookeeper.ReadOnlyZKClient(139): Connect 0x46373cc8 to 127.0.0.1:64825 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 17:54:06,416 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7a05cc8c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 17:54:06,416 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 17:54:07,252 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103e975b07f5cd943f98d70a9a14db5305f to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103e975b07f5cd943f98d70a9a14db5305f 2023-02-13 17:54:07,253 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 17:54:07,266 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 17:54:07,267 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43050, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 17:54:07,274 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 17:54:07,276 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41082, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 17:54:07,289 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/dd1b375b55e042418ade201d1af4f4c0 first=Optional[r5] last=Optional[r6] 2023-02-13 17:54:07,290 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1676310835316.0cfde756752436e731853466f9c70810., hostname=jenkins-hbase4.apache.org,38881,1676310818035, seqNum=2 for row with hfile group [{family1,hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/dd1b375b55e042418ade201d1af4f4c0}] 2023-02-13 17:54:07,294 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(763): Validating hfile at hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/dd1b375b55e042418ade201d1af4f4c0 for inclusion in 0cfde756752436e731853466f9c70810/family1 2023-02-13 17:54:07,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-02-13 17:54:07,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 17:54:07,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegion(2445): Flush status journal for 0cfde756752436e731853466f9c70810: 2023-02-13 17:54:07,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/dd1b375b55e042418ade201d1af4f4c0 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithMonthlyPolicy__q8drbt9688c2f8abvphh2hpor0it36gthvq9udpfn130fvpim9koq72gvolqhhu3/family1/dd1b375b55e042418ade201d1af4f4c0 2023-02-13 17:54:07,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithMonthlyPolicy__q8drbt9688c2f8abvphh2hpor0it36gthvq9udpfn130fvpim9koq72gvolqhhu3/family1/dd1b375b55e042418ade201d1af4f4c0 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/c2b693f848bb4b4ea57cc5089a2ed1f6_SeqId_44_ 2023-02-13 17:54:07,302 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(849): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithMonthlyPolicy__q8drbt9688c2f8abvphh2hpor0it36gthvq9udpfn130fvpim9koq72gvolqhhu3/family1/dd1b375b55e042418ade201d1af4f4c0 into 0cfde756752436e731853466f9c70810/family1 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/c2b693f848bb4b4ea57cc5089a2ed1f6_SeqId_44_ - updating store file list. 2023-02-13 17:54:07,307 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(882): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/c2b693f848bb4b4ea57cc5089a2ed1f6_SeqId_44_ into 0cfde756752436e731853466f9c70810/family1 2023-02-13 17:54:07,307 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(855): Successfully loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithMonthlyPolicy__q8drbt9688c2f8abvphh2hpor0it36gthvq9udpfn130fvpim9koq72gvolqhhu3/family1/dd1b375b55e042418ade201d1af4f4c0 into 0cfde756752436e731853466f9c70810/family1 (new location: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/c2b693f848bb4b4ea57cc5089a2ed1f6_SeqId_44_) 2023-02-13 17:54:07,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithMonthlyPolicy__q8drbt9688c2f8abvphh2hpor0it36gthvq9udpfn130fvpim9koq72gvolqhhu3/family1/dd1b375b55e042418ade201d1af4f4c0 2023-02-13 17:54:07,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-13 17:54:07,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-13 17:54:07,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(1912): 0cfde756752436e731853466f9c70810/family1 is initiating minor compaction 2023-02-13 17:54:07,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@40d410ba; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 17:54:07,312 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 0cfde756752436e731853466f9c70810/family1 in testMajorCompactionWithMonthlyPolicy,,1676310835316.0cfde756752436e731853466f9c70810. 2023-02-13 17:54:07,312 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/8d66c220406148549aec8462e0bc6aca, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/9bef69aa57034abc8dddb4005556b930, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/1e7cecf3375345c8bc73e65cfd8eb352, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/401f0ca67c264a9a9eabb26594ecbcc0, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/5b68d856ef9f46a3b73df9be14fc663b, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/3bf0b71c0ac54f93a2c047af990495b5, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/9fb3260b6ec54c49b2f0b9290151296c, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/e31bcdf5171c496c8dc4a91d1aed613a, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/3581f66a05e34413852b8ad68f3a2526, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/c2b693f848bb4b4ea57cc5089a2ed1f6_SeqId_44_] into tmpdir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/.tmp, totalSize=49.7 K 2023-02-13 17:54:07,312 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting 8d66c220406148549aec8462e0bc6aca, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-13 17:54:07,313 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting 9bef69aa57034abc8dddb4005556b930, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-13 17:54:07,313 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting 1e7cecf3375345c8bc73e65cfd8eb352, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-13 17:54:07,313 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting 401f0ca67c264a9a9eabb26594ecbcc0, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-13 17:54:07,313 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting 5b68d856ef9f46a3b73df9be14fc663b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-13 17:54:07,313 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting 3bf0b71c0ac54f93a2c047af990495b5, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-13 17:54:07,313 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting 9fb3260b6ec54c49b2f0b9290151296c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-13 17:54:07,313 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting e31bcdf5171c496c8dc4a91d1aed613a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-13 17:54:07,313 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting 3581f66a05e34413852b8ad68f3a2526, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-13 17:54:07,313 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting c2b693f848bb4b4ea57cc5089a2ed1f6_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-13 17:54:07,315 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 17:54:07,315 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:54:07,317 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101a87bd1ed36cd40a8860f54e9bf8feef4 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101a87bd1ed36cd40a8860f54e9bf8feef4 2023-02-13 17:54:07,319 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103d3332fa73a0e4854babcf27584e50f72 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103d3332fa73a0e4854babcf27584e50f72 2023-02-13 17:54:07,319 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-02-13 17:54:07,319 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-02-13 17:54:07,319 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 17:54:07,319 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 17:54:07,350 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] throttle.PressureAwareThroughputController(145): 0cfde756752436e731853466f9c70810#family1#compaction#22 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 17:54:07,769 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/.tmp/family1/d828a514b3df4675b1c3b290c40a67d4 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/d828a514b3df4675b1c3b290c40a67d4 2023-02-13 17:54:07,775 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 0cfde756752436e731853466f9c70810/family1 of 0cfde756752436e731853466f9c70810 into d828a514b3df4675b1c3b290c40a67d4(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 17:54:07,776 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 0cfde756752436e731853466f9c70810: 2023-02-13 17:54:07,776 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1676310835316.0cfde756752436e731853466f9c70810., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1676310847312; duration=0sec 2023-02-13 17:54:07,776 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 17:54:07,865 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/8d66c220406148549aec8462e0bc6aca, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/9bef69aa57034abc8dddb4005556b930, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/1e7cecf3375345c8bc73e65cfd8eb352, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/401f0ca67c264a9a9eabb26594ecbcc0, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/5b68d856ef9f46a3b73df9be14fc663b, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/3bf0b71c0ac54f93a2c047af990495b5, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/9fb3260b6ec54c49b2f0b9290151296c, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/e31bcdf5171c496c8dc4a91d1aed613a, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/3581f66a05e34413852b8ad68f3a2526, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/c2b693f848bb4b4ea57cc5089a2ed1f6_SeqId_44_] to archive 2023-02-13 17:54:07,866 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:54:07,868 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/8d66c220406148549aec8462e0bc6aca to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/8d66c220406148549aec8462e0bc6aca 2023-02-13 17:54:07,869 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/9bef69aa57034abc8dddb4005556b930 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/9bef69aa57034abc8dddb4005556b930 2023-02-13 17:54:07,871 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/1e7cecf3375345c8bc73e65cfd8eb352 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/1e7cecf3375345c8bc73e65cfd8eb352 2023-02-13 17:54:07,872 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/401f0ca67c264a9a9eabb26594ecbcc0 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/401f0ca67c264a9a9eabb26594ecbcc0 2023-02-13 17:54:07,873 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/5b68d856ef9f46a3b73df9be14fc663b to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/5b68d856ef9f46a3b73df9be14fc663b 2023-02-13 17:54:07,874 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/3bf0b71c0ac54f93a2c047af990495b5 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/3bf0b71c0ac54f93a2c047af990495b5 2023-02-13 17:54:07,875 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/9fb3260b6ec54c49b2f0b9290151296c to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/9fb3260b6ec54c49b2f0b9290151296c 2023-02-13 17:54:07,877 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/e31bcdf5171c496c8dc4a91d1aed613a to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/e31bcdf5171c496c8dc4a91d1aed613a 2023-02-13 17:54:07,878 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/3581f66a05e34413852b8ad68f3a2526 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/3581f66a05e34413852b8ad68f3a2526 2023-02-13 17:54:07,879 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/c2b693f848bb4b4ea57cc5089a2ed1f6_SeqId_44_ to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/c2b693f848bb4b4ea57cc5089a2ed1f6_SeqId_44_ 2023-02-13 17:54:08,175 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512319f8e979a392649b58e005f47a2acf0ae to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512319f8e979a392649b58e005f47a2acf0ae 2023-02-13 17:54:08,176 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 17:54:08,201 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/cc5bec34f6c54a20910742a319a45421 first=Optional[r1] last=Optional[r4] 2023-02-13 17:54:08,202 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1676310835316.0cfde756752436e731853466f9c70810., hostname=jenkins-hbase4.apache.org,38881,1676310818035, seqNum=2 for row with hfile group [{family1,hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/cc5bec34f6c54a20910742a319a45421}] 2023-02-13 17:54:08,203 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(763): Validating hfile at hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/cc5bec34f6c54a20910742a319a45421 for inclusion in 0cfde756752436e731853466f9c70810/family1 2023-02-13 17:54:08,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-02-13 17:54:08,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 17:54:08,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegion(2445): Flush status journal for 0cfde756752436e731853466f9c70810: 2023-02-13 17:54:08,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/cc5bec34f6c54a20910742a319a45421 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithMonthlyPolicy__keeprup45o0ehgld2bbatgn4iv3m4hk2vm0f0m8a8jhqklc8972m0taenbgfptck/family1/cc5bec34f6c54a20910742a319a45421 2023-02-13 17:54:08,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithMonthlyPolicy__keeprup45o0ehgld2bbatgn4iv3m4hk2vm0f0m8a8jhqklc8972m0taenbgfptck/family1/cc5bec34f6c54a20910742a319a45421 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/1a823f1d12854ee486e9c6bf52a21736_SeqId_47_ 2023-02-13 17:54:08,211 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(849): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithMonthlyPolicy__keeprup45o0ehgld2bbatgn4iv3m4hk2vm0f0m8a8jhqklc8972m0taenbgfptck/family1/cc5bec34f6c54a20910742a319a45421 into 0cfde756752436e731853466f9c70810/family1 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/1a823f1d12854ee486e9c6bf52a21736_SeqId_47_ - updating store file list. 2023-02-13 17:54:08,216 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(882): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/1a823f1d12854ee486e9c6bf52a21736_SeqId_47_ into 0cfde756752436e731853466f9c70810/family1 2023-02-13 17:54:08,216 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(855): Successfully loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithMonthlyPolicy__keeprup45o0ehgld2bbatgn4iv3m4hk2vm0f0m8a8jhqklc8972m0taenbgfptck/family1/cc5bec34f6c54a20910742a319a45421 into 0cfde756752436e731853466f9c70810/family1 (new location: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/1a823f1d12854ee486e9c6bf52a21736_SeqId_47_) 2023-02-13 17:54:08,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithMonthlyPolicy__keeprup45o0ehgld2bbatgn4iv3m4hk2vm0f0m8a8jhqklc8972m0taenbgfptck/family1/cc5bec34f6c54a20910742a319a45421 2023-02-13 17:54:08,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-13 17:54:08,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-13 17:54:08,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(1912): 0cfde756752436e731853466f9c70810/family1 is initiating minor compaction (all files) 2023-02-13 17:54:08,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@18032e05; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 17:54:08,218 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 0cfde756752436e731853466f9c70810/family1 in testMajorCompactionWithMonthlyPolicy,,1676310835316.0cfde756752436e731853466f9c70810. 2023-02-13 17:54:08,218 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/233d809951f34f8bb4495dc06509ce51, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/d828a514b3df4675b1c3b290c40a67d4, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/1a823f1d12854ee486e9c6bf52a21736_SeqId_47_] into tmpdir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/.tmp, totalSize=178.1 K 2023-02-13 17:54:08,219 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting 233d809951f34f8bb4495dc06509ce51, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878841551 2023-02-13 17:54:08,219 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting d828a514b3df4675b1c3b290c40a67d4, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621241551 2023-02-13 17:54:08,220 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting 1a823f1d12854ee486e9c6bf52a21736_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965241551 2023-02-13 17:54:08,220 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 17:54:08,221 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:54:08,222 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512015a8027d4ab294b6ca3aaafb31c486527 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512015a8027d4ab294b6ca3aaafb31c486527 2023-02-13 17:54:08,224 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205bb300cd0f132426680257480ce7cb64f to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205bb300cd0f132426680257480ce7cb64f 2023-02-13 17:54:08,225 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015122890b7a4316b0d4dc2af52192bcd8a9dd7 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015122890b7a4316b0d4dc2af52192bcd8a9dd7 2023-02-13 17:54:08,227 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231111af975889a40008287e9bb330bc8a7 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231111af975889a40008287e9bb330bc8a7 2023-02-13 17:54:08,227 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-02-13 17:54:08,227 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-02-13 17:54:08,227 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 17:54:08,227 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 17:54:08,241 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] throttle.PressureAwareThroughputController(145): 0cfde756752436e731853466f9c70810#family1#compaction#23 average throughput is 12.97 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 17:54:09,070 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/.tmp/family1/cbfdb22becb04d1c91e179df50098220 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/cbfdb22becb04d1c91e179df50098220 2023-02-13 17:54:09,076 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 0cfde756752436e731853466f9c70810/family1 of 0cfde756752436e731853466f9c70810 into cbfdb22becb04d1c91e179df50098220(size=167.4 K), total size for store is 167.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 17:54:09,076 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 0cfde756752436e731853466f9c70810: 2023-02-13 17:54:09,077 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1676310835316.0cfde756752436e731853466f9c70810., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1676310848218; duration=0sec 2023-02-13 17:54:09,077 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 17:54:09,077 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130f7b3f72b1d504fff80d1becbf4ccc393 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130f7b3f72b1d504fff80d1becbf4ccc393 2023-02-13 17:54:09,078 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 17:54:09,103 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/a5ebd5357e6a4ae08f0a4750a9331529 first=Optional[r00] last=Optional[r8] 2023-02-13 17:54:09,104 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1676310835316.0cfde756752436e731853466f9c70810., hostname=jenkins-hbase4.apache.org,38881,1676310818035, seqNum=2 for row with hfile group [{family1,hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/a5ebd5357e6a4ae08f0a4750a9331529}] 2023-02-13 17:54:09,106 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(763): Validating hfile at hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/a5ebd5357e6a4ae08f0a4750a9331529 for inclusion in 0cfde756752436e731853466f9c70810/family1 2023-02-13 17:54:09,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-02-13 17:54:09,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 17:54:09,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegion(2445): Flush status journal for 0cfde756752436e731853466f9c70810: 2023-02-13 17:54:09,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/a5ebd5357e6a4ae08f0a4750a9331529 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithMonthlyPolicy__c844lrpjjqm56de4fq3jmi0njtijin8ljv0ceb194vj0high7k7spjjvshton02j/family1/a5ebd5357e6a4ae08f0a4750a9331529 2023-02-13 17:54:09,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithMonthlyPolicy__c844lrpjjqm56de4fq3jmi0njtijin8ljv0ceb194vj0high7k7spjjvshton02j/family1/a5ebd5357e6a4ae08f0a4750a9331529 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/3695c320889747d19763fba5c67cb90d_SeqId_50_ 2023-02-13 17:54:09,113 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(849): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithMonthlyPolicy__c844lrpjjqm56de4fq3jmi0njtijin8ljv0ceb194vj0high7k7spjjvshton02j/family1/a5ebd5357e6a4ae08f0a4750a9331529 into 0cfde756752436e731853466f9c70810/family1 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/3695c320889747d19763fba5c67cb90d_SeqId_50_ - updating store file list. 2023-02-13 17:54:09,117 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(882): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/3695c320889747d19763fba5c67cb90d_SeqId_50_ into 0cfde756752436e731853466f9c70810/family1 2023-02-13 17:54:09,117 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(855): Successfully loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithMonthlyPolicy__c844lrpjjqm56de4fq3jmi0njtijin8ljv0ceb194vj0high7k7spjjvshton02j/family1/a5ebd5357e6a4ae08f0a4750a9331529 into 0cfde756752436e731853466f9c70810/family1 (new location: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/3695c320889747d19763fba5c67cb90d_SeqId_50_) 2023-02-13 17:54:09,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithMonthlyPolicy__c844lrpjjqm56de4fq3jmi0njtijin8ljv0ceb194vj0high7k7spjjvshton02j/family1/a5ebd5357e6a4ae08f0a4750a9331529 2023-02-13 17:54:09,120 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 17:54:09,121 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:54:09,122 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112053e8406631cb4b759f4ca57aac74ced2 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112053e8406631cb4b759f4ca57aac74ced2 2023-02-13 17:54:09,123 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128e9329db0769c475cb12193b5d8f8e275 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128e9329db0769c475cb12193b5d8f8e275 2023-02-13 17:54:09,124 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015113034994c47509943c7b3da2cec130b73b0 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015113034994c47509943c7b3da2cec130b73b0 2023-02-13 17:54:09,124 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-02-13 17:54:09,124 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-13 17:54:09,125 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 17:54:09,125 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 17:54:09,125 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 17:54:09,125 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 17:54:09,125 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 17:54:09,126 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-13 17:54:09,128 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.7210 sec 2023-02-13 17:54:09,159 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/233d809951f34f8bb4495dc06509ce51, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/d828a514b3df4675b1c3b290c40a67d4, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/1a823f1d12854ee486e9c6bf52a21736_SeqId_47_] to archive 2023-02-13 17:54:09,160 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:54:09,162 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/233d809951f34f8bb4495dc06509ce51 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/233d809951f34f8bb4495dc06509ce51 2023-02-13 17:54:09,164 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/d828a514b3df4675b1c3b290c40a67d4 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/d828a514b3df4675b1c3b290c40a67d4 2023-02-13 17:54:09,165 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/1a823f1d12854ee486e9c6bf52a21736_SeqId_47_ to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/family1/1a823f1d12854ee486e9c6bf52a21736_SeqId_47_ 2023-02-13 17:54:09,166 DEBUG [hfile_cleaner-dir-scan-pool-1] cleaner.CleanerChore(483): Couldn't delete 'hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data' yet because it isn't empty w/exception. org.apache.hadoop.fs.PathIsNotEmptyDirectoryException: ``/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) ': Directory is not empty: `/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:1595) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:881) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:878) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.delete(DistributedFileSystem.java:878) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$null$4(CleanerChore.java:453) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.deleteAction(CleanerChore.java:478) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:453) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:455) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:455) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:455) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:455) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture.uniWhenCompleteStage(CompletableFuture.java:792) at java.util.concurrent.CompletableFuture.whenComplete(CompletableFuture.java:2153) at org.apache.hadoop.hbase.util.FutureUtils.addListener(FutureUtils.java:61) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.traverseAndDelete(CleanerChore.java:439) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$null$2(CleanerChore.java:432) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.fs.PathIsNotEmptyDirectoryException): `/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.delete(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.delete(ClientNamenodeProtocolTranslatorPB.java:572) at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:1593) ... 41 more 2023-02-13 17:54:09,229 INFO [Listener at localhost/35343] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=254 (was 247) Potentially hanging thread: hconnection-0x36b00319-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b2e1a147-a5e4-cd2d-85aa-2dcb3ac8be25/cluster_42c07e65-ff5f-a75e-a69f-8f3d2a010de7/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1033540925_15 at /127.0.0.1:60098 [Waiting for operation #18] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1888498606_15 at /127.0.0.1:60140 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1888498606_15 at /127.0.0.1:60204 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1888498606_15 at /127.0.0.1:60294 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1888498606_15 at /127.0.0.1:60032 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1888498606_15 at /127.0.0.1:60218 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1888498606_15 at /127.0.0.1:60220 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x36b00319-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1888498606_15 at /127.0.0.1:60234 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1888498606_15 at /127.0.0.1:60248 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1888498606_15 at /127.0.0.1:60096 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1888498606_15 at /127.0.0.1:60064 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x36b00319-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64825@0x46373cc8-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: hconnection-0x36b00319-shared-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64825@0x46373cc8-SendThread(127.0.0.1:64825) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1888498606_15 at /127.0.0.1:60184 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1888498606_15 at /127.0.0.1:60000 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:64825@0x46373cc8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/849799958.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x36b00319-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1033540925_15 at /127.0.0.1:60148 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1888498606_15 at /127.0.0.1:60082 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x36b00319-shared-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x36b00319-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1888498606_15 at /127.0.0.1:60306 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1888498606_15 at /127.0.0.1:60124 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=612 (was 599) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=299 (was 336), ProcessCount=168 (was 168), AvailableMemoryMB=1859 (was 1247) - AvailableMemoryMB LEAK? - 2023-02-13 17:54:09,242 INFO [Listener at localhost/35343] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=254, OpenFileDescriptor=612, MaxFileDescriptor=60000, SystemLoadAverage=299, ProcessCount=168, AvailableMemoryMB=1858 2023-02-13 17:54:09,245 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-13 17:54:09,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure2.ProcedureExecutor(1029): Stored pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:09,247 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 17:54:09,248 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithWeeklyPolicy" procId is: 23 2023-02-13 17:54:09,248 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 17:54:09,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-13 17:54:09,250 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8 2023-02-13 17:54:09,250 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8 empty. 2023-02-13 17:54:09,251 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8 2023-02-13 17:54:09,251 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithWeeklyPolicy regions 2023-02-13 17:54:09,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-13 17:54:09,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-13 17:54:09,661 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-02-13 17:54:09,663 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7671): creating {ENCODED => e0bf4ad0d89965bdcd22d3ba4d2aebf8, NAME => 'testMinorCompactionWithWeeklyPolicy,,1676310849244.e0bf4ad0d89965bdcd22d3ba4d2aebf8.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp 2023-02-13 17:54:09,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-13 17:54:10,069 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(865): Instantiated testMinorCompactionWithWeeklyPolicy,,1676310849244.e0bf4ad0d89965bdcd22d3ba4d2aebf8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 17:54:10,069 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1603): Closing e0bf4ad0d89965bdcd22d3ba4d2aebf8, disabling compactions & flushes 2023-02-13 17:54:10,069 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1625): Closing region testMinorCompactionWithWeeklyPolicy,,1676310849244.e0bf4ad0d89965bdcd22d3ba4d2aebf8. 2023-02-13 17:54:10,069 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1676310849244.e0bf4ad0d89965bdcd22d3ba4d2aebf8. 2023-02-13 17:54:10,069 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1713): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1676310849244.e0bf4ad0d89965bdcd22d3ba4d2aebf8. after waiting 0 ms 2023-02-13 17:54:10,069 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1723): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1676310849244.e0bf4ad0d89965bdcd22d3ba4d2aebf8. 2023-02-13 17:54:10,069 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1837): Closed testMinorCompactionWithWeeklyPolicy,,1676310849244.e0bf4ad0d89965bdcd22d3ba4d2aebf8. 2023-02-13 17:54:10,069 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1557): Region close journal for e0bf4ad0d89965bdcd22d3ba4d2aebf8: Waiting for close lock at 1676310850069Disabling compacts and flushes for region at 1676310850069Disabling writes for close at 1676310850069Writing region close event to WAL at 1676310850069Closed at 1676310850069 2023-02-13 17:54:10,072 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 17:54:10,073 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithWeeklyPolicy,,1676310849244.e0bf4ad0d89965bdcd22d3ba4d2aebf8.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676310850073"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676310850073"}]},"ts":"1676310850073"} 2023-02-13 17:54:10,075 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 17:54:10,075 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 17:54:10,076 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676310850075"}]},"ts":"1676310850075"} 2023-02-13 17:54:10,077 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-02-13 17:54:10,082 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=e0bf4ad0d89965bdcd22d3ba4d2aebf8, ASSIGN}] 2023-02-13 17:54:10,084 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=e0bf4ad0d89965bdcd22d3ba4d2aebf8, ASSIGN 2023-02-13 17:54:10,085 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=e0bf4ad0d89965bdcd22d3ba4d2aebf8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38881,1676310818035; forceNewPlan=false, retain=false 2023-02-13 17:54:10,236 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=e0bf4ad0d89965bdcd22d3ba4d2aebf8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:10,236 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithWeeklyPolicy,,1676310849244.e0bf4ad0d89965bdcd22d3ba4d2aebf8.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676310850236"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676310850236"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676310850236"}]},"ts":"1676310850236"} 2023-02-13 17:54:10,238 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure e0bf4ad0d89965bdcd22d3ba4d2aebf8, server=jenkins-hbase4.apache.org,38881,1676310818035}] 2023-02-13 17:54:10,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-13 17:54:10,393 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMinorCompactionWithWeeklyPolicy,,1676310849244.e0bf4ad0d89965bdcd22d3ba4d2aebf8. 2023-02-13 17:54:10,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e0bf4ad0d89965bdcd22d3ba4d2aebf8, NAME => 'testMinorCompactionWithWeeklyPolicy,,1676310849244.e0bf4ad0d89965bdcd22d3ba4d2aebf8.', STARTKEY => '', ENDKEY => ''} 2023-02-13 17:54:10,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithWeeklyPolicy e0bf4ad0d89965bdcd22d3ba4d2aebf8 2023-02-13 17:54:10,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMinorCompactionWithWeeklyPolicy,,1676310849244.e0bf4ad0d89965bdcd22d3ba4d2aebf8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 17:54:10,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e0bf4ad0d89965bdcd22d3ba4d2aebf8 2023-02-13 17:54:10,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e0bf4ad0d89965bdcd22d3ba4d2aebf8 2023-02-13 17:54:10,395 INFO [StoreOpener-e0bf4ad0d89965bdcd22d3ba4d2aebf8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e0bf4ad0d89965bdcd22d3ba4d2aebf8 2023-02-13 17:54:10,396 DEBUG [StoreOpener-e0bf4ad0d89965bdcd22d3ba4d2aebf8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1 2023-02-13 17:54:10,396 DEBUG [StoreOpener-e0bf4ad0d89965bdcd22d3ba4d2aebf8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1 2023-02-13 17:54:10,397 INFO [StoreOpener-e0bf4ad0d89965bdcd22d3ba4d2aebf8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e0bf4ad0d89965bdcd22d3ba4d2aebf8 columnFamilyName family1 2023-02-13 17:54:10,398 INFO [StoreOpener-e0bf4ad0d89965bdcd22d3ba4d2aebf8-1] regionserver.HStore(310): Store=e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 17:54:10,399 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8 2023-02-13 17:54:10,399 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8 2023-02-13 17:54:10,402 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e0bf4ad0d89965bdcd22d3ba4d2aebf8 2023-02-13 17:54:10,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 17:54:10,404 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e0bf4ad0d89965bdcd22d3ba4d2aebf8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73262874, jitterRate=0.09170189499855042}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 17:54:10,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e0bf4ad0d89965bdcd22d3ba4d2aebf8: Running coprocessor pre-open hook at 1676310850394Writing region info on filesystem at 1676310850394Initializing all the Stores at 1676310850394Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1676310850394Cleaning up temporary data from old regions at 1676310850400 (+6 ms)Cleaning up detritus from prior splits at 1676310850400Running coprocessor post-open hooks at 1676310850404 (+4 ms)Region opened successfully at 1676310850404 2023-02-13 17:54:10,405 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMinorCompactionWithWeeklyPolicy,,1676310849244.e0bf4ad0d89965bdcd22d3ba4d2aebf8., pid=25, masterSystemTime=1676310850390 2023-02-13 17:54:10,406 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMinorCompactionWithWeeklyPolicy,,1676310849244.e0bf4ad0d89965bdcd22d3ba4d2aebf8. 2023-02-13 17:54:10,406 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMinorCompactionWithWeeklyPolicy,,1676310849244.e0bf4ad0d89965bdcd22d3ba4d2aebf8. 2023-02-13 17:54:10,407 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=e0bf4ad0d89965bdcd22d3ba4d2aebf8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:10,407 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithWeeklyPolicy,,1676310849244.e0bf4ad0d89965bdcd22d3ba4d2aebf8.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676310850407"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676310850407"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676310850407"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676310850407"}]},"ts":"1676310850407"} 2023-02-13 17:54:10,410 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=24 2023-02-13 17:54:10,410 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure e0bf4ad0d89965bdcd22d3ba4d2aebf8, server=jenkins-hbase4.apache.org,38881,1676310818035 in 171 msec 2023-02-13 17:54:10,412 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-02-13 17:54:10,412 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=e0bf4ad0d89965bdcd22d3ba4d2aebf8, ASSIGN in 328 msec 2023-02-13 17:54:10,413 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 17:54:10,413 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676310850413"}]},"ts":"1676310850413"} 2023-02-13 17:54:10,414 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-02-13 17:54:10,417 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 17:54:10,418 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=23, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy in 1.1720 sec 2023-02-13 17:54:11,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-13 17:54:11,354 INFO [Listener at localhost/35343] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithWeeklyPolicy, procId: 23 completed 2023-02-13 17:54:11,378 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:54:11,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:11,380 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 17:54:11,380 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:11,380 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 17:54:11,380 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 17:54:11,381 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:11,381 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:11,382 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:11,382 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:11,382 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:11,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:11,382 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:11,382 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:54:11,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:11,383 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:11,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:54:11,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:11,383 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:11,383 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:11,383 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 17:54:11,383 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:11,383 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 17:54:11,384 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:54:11,384 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:54:11,384 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676310849244.e0bf4ad0d89965bdcd22d3ba4d2aebf8. 2023-02-13 17:54:11,384 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676310849244.e0bf4ad0d89965bdcd22d3ba4d2aebf8. started... 2023-02-13 17:54:11,385 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e0bf4ad0d89965bdcd22d3ba4d2aebf8 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-13 17:54:11,810 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113081f754fdd0bc430880be9f2fcc71597a to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015113081f754fdd0bc430880be9f2fcc71597a 2023-02-13 17:54:12,214 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/.tmp/family1/49f51d1bdf5a4d2998bee0d1ba69b7ec 2023-02-13 17:54:12,221 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/.tmp/family1/49f51d1bdf5a4d2998bee0d1ba69b7ec as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/49f51d1bdf5a4d2998bee0d1ba69b7ec 2023-02-13 17:54:12,225 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/49f51d1bdf5a4d2998bee0d1ba69b7ec, entries=1000, sequenceid=5, filesize=165.1 K 2023-02-13 17:54:12,226 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for e0bf4ad0d89965bdcd22d3ba4d2aebf8 in 841ms, sequenceid=5, compaction requested=false 2023-02-13 17:54:12,226 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 17:54:12,227 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e0bf4ad0d89965bdcd22d3ba4d2aebf8: 2023-02-13 17:54:12,227 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676310849244.e0bf4ad0d89965bdcd22d3ba4d2aebf8. 2023-02-13 17:54:12,227 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:54:12,227 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:54:12,227 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:12,227 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 17:54:12,227 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-13 17:54:12,229 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:12,229 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:12,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:12,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:12,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:12,229 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:12,229 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:54:12,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:12,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:12,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:12,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:12,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:12,230 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 17:54:12,230 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2a679170[Count = 0] remaining members to acquire global barrier 2023-02-13 17:54:12,230 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 17:54:12,230 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:12,231 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:12,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:12,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:12,232 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 17:54:12,232 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-13 17:54:12,232 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:54:12,232 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:12,232 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:54:12,234 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:12,234 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 17:54:12,234 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:12,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:12,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:12,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:12,234 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-13 17:54:12,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:12,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:12,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:12,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:12,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:12,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:12,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:12,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:54:12,236 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 17:54:12,236 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-13 17:54:12,236 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:54:12,236 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:54:12,236 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:12,236 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:54:12,238 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:12,238 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:12,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:12,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:12,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:12,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:12,238 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:12,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:12,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:12,238 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:12,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:12,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:12,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:12,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:12,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:12,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:12,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:12,240 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:12,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:12,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:12,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:12,242 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:12,242 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:12,242 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:12,242 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:12,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:12,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:12,242 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:12,242 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 17:54:12,243 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:54:12,242 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:12,243 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 17:54:12,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:12,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:12,243 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:12,243 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:12,243 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:12,243 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 17:54:12,243 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:12,243 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:54:12,343 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:54:12,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:54:12,348 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:54:12,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 17:54:12,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:12,350 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 17:54:12,350 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:12,350 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 17:54:12,350 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 17:54:12,351 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:12,351 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:12,352 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:12,352 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:12,352 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:12,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:12,352 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:12,352 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:54:12,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:12,353 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:12,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:54:12,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:12,353 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:12,353 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 17:54:12,353 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:12,353 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 17:54:12,353 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:12,353 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 17:54:12,354 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:54:12,354 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:54:12,354 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676310849244.e0bf4ad0d89965bdcd22d3ba4d2aebf8. 2023-02-13 17:54:12,354 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676310849244.e0bf4ad0d89965bdcd22d3ba4d2aebf8. started... 2023-02-13 17:54:12,354 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e0bf4ad0d89965bdcd22d3ba4d2aebf8 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-13 17:54:12,767 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128a43655646162403ba3fb86c336088339 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151128a43655646162403ba3fb86c336088339 2023-02-13 17:54:13,173 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/.tmp/family1/6cf98862c4484af293fedb4d70cc6a80 2023-02-13 17:54:13,179 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/.tmp/family1/6cf98862c4484af293fedb4d70cc6a80 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/6cf98862c4484af293fedb4d70cc6a80 2023-02-13 17:54:13,183 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/6cf98862c4484af293fedb4d70cc6a80, entries=1, sequenceid=9, filesize=5.0 K 2023-02-13 17:54:13,184 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for e0bf4ad0d89965bdcd22d3ba4d2aebf8 in 830ms, sequenceid=9, compaction requested=false 2023-02-13 17:54:13,184 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e0bf4ad0d89965bdcd22d3ba4d2aebf8: 2023-02-13 17:54:13,184 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676310849244.e0bf4ad0d89965bdcd22d3ba4d2aebf8. 2023-02-13 17:54:13,184 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:54:13,184 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:54:13,184 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:13,184 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 17:54:13,184 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-13 17:54:13,192 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:13,192 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:13,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:13,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:13,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:13,192 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:13,193 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:54:13,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:13,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:13,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:13,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:13,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:13,194 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 17:54:13,194 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7f168106[Count = 0] remaining members to acquire global barrier 2023-02-13 17:54:13,194 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 17:54:13,194 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:13,195 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:13,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:13,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:13,195 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 17:54:13,195 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-13 17:54:13,195 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:13,195 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:54:13,195 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:54:13,196 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 17:54:13,196 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:13,196 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:13,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:13,196 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-13 17:54:13,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:13,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:13,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:13,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:13,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:13,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:13,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:13,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:13,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:13,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:54:13,199 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 17:54:13,199 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-13 17:54:13,199 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:54:13,199 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:54:13,199 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:13,199 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:54:13,200 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:13,200 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:13,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:13,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:13,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:13,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:13,200 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:13,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:13,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:13,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:13,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:13,201 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:13,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:13,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:13,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:13,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:13,202 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:13,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:13,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:13,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:13,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:13,204 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:13,204 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:13,204 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:13,204 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:13,204 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:13,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:13,204 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:13,204 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 17:54:13,205 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:54:13,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:13,205 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:13,205 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:13,205 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:13,205 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:13,205 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 17:54:13,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:13,205 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:54:13,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:13,305 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:54:13,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:54:13,310 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:54:13,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 17:54:13,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:13,312 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 17:54:13,312 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:13,312 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 17:54:13,312 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 17:54:13,313 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:13,313 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:13,314 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:13,314 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:13,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:13,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:13,314 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:13,314 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:54:13,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:13,315 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:13,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:54:13,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:13,315 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:13,315 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 17:54:13,315 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:13,315 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 17:54:13,315 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:13,315 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 17:54:13,316 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:54:13,316 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:54:13,316 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676310849244.e0bf4ad0d89965bdcd22d3ba4d2aebf8. 2023-02-13 17:54:13,316 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676310849244.e0bf4ad0d89965bdcd22d3ba4d2aebf8. started... 2023-02-13 17:54:13,316 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e0bf4ad0d89965bdcd22d3ba4d2aebf8 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 17:54:13,733 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512013910d17dfbb04be3a56931e8333b2414 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512013910d17dfbb04be3a56931e8333b2414 2023-02-13 17:54:14,139 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/.tmp/family1/251135e41519440fb2be45d215e50d00 2023-02-13 17:54:14,145 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/.tmp/family1/251135e41519440fb2be45d215e50d00 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/251135e41519440fb2be45d215e50d00 2023-02-13 17:54:14,149 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/251135e41519440fb2be45d215e50d00, entries=1, sequenceid=13, filesize=4.9 K 2023-02-13 17:54:14,150 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e0bf4ad0d89965bdcd22d3ba4d2aebf8 in 834ms, sequenceid=13, compaction requested=true 2023-02-13 17:54:14,150 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e0bf4ad0d89965bdcd22d3ba4d2aebf8: 2023-02-13 17:54:14,150 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676310849244.e0bf4ad0d89965bdcd22d3ba4d2aebf8. 2023-02-13 17:54:14,150 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:54:14,151 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:54:14,151 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:14,151 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 17:54:14,151 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-13 17:54:14,152 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:14,152 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:14,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:14,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:14,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:14,153 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:14,153 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:54:14,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:14,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:14,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:14,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:14,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:14,154 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 17:54:14,154 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b04cc0c[Count = 0] remaining members to acquire global barrier 2023-02-13 17:54:14,154 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 17:54:14,154 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:14,156 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:14,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:14,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:14,157 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 17:54:14,157 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-13 17:54:14,157 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:54:14,157 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:14,157 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:54:14,158 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:14,158 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 17:54:14,158 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:14,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:14,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:14,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:14,158 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-13 17:54:14,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:14,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:14,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:14,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:14,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:14,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:14,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:14,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:54:14,160 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 17:54:14,160 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-13 17:54:14,160 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:54:14,160 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:54:14,160 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:14,160 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:54:14,162 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:14,162 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:14,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:14,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:14,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:14,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:14,162 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:14,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:14,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:14,162 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:14,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:14,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:14,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:14,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:14,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:14,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:14,163 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:14,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:14,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:14,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:14,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:14,169 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:14,169 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:14,169 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:14,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:14,169 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 17:54:14,169 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:54:14,169 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:14,169 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 17:54:14,169 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:14,169 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:14,169 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:14,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:14,169 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:14,169 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 17:54:14,170 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:54:14,169 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:14,170 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:14,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:14,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:14,270 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:54:14,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:54:14,275 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:54:14,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 17:54:14,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:14,276 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 17:54:14,276 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:14,276 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 17:54:14,276 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 17:54:14,277 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:14,277 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:14,278 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:14,278 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:14,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:14,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:14,278 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:14,278 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:54:14,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:14,279 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:14,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:54:14,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:14,279 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:14,279 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 17:54:14,280 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:14,280 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 17:54:14,280 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:14,280 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 17:54:14,280 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:54:14,280 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:54:14,280 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676310849244.e0bf4ad0d89965bdcd22d3ba4d2aebf8. 2023-02-13 17:54:14,280 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676310849244.e0bf4ad0d89965bdcd22d3ba4d2aebf8. started... 2023-02-13 17:54:14,280 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e0bf4ad0d89965bdcd22d3ba4d2aebf8 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 17:54:14,695 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205abe51f85476c428eab9bc1346daf9443 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205abe51f85476c428eab9bc1346daf9443 2023-02-13 17:54:15,101 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/.tmp/family1/0d64bbfac6d746dc9aec674de80d30fb 2023-02-13 17:54:15,107 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/.tmp/family1/0d64bbfac6d746dc9aec674de80d30fb as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/0d64bbfac6d746dc9aec674de80d30fb 2023-02-13 17:54:15,112 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/0d64bbfac6d746dc9aec674de80d30fb, entries=1, sequenceid=17, filesize=4.9 K 2023-02-13 17:54:15,113 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e0bf4ad0d89965bdcd22d3ba4d2aebf8 in 833ms, sequenceid=17, compaction requested=true 2023-02-13 17:54:15,113 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e0bf4ad0d89965bdcd22d3ba4d2aebf8: 2023-02-13 17:54:15,113 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676310849244.e0bf4ad0d89965bdcd22d3ba4d2aebf8. 2023-02-13 17:54:15,113 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:54:15,113 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:54:15,113 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:15,113 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 17:54:15,113 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-13 17:54:15,115 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:15,115 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:15,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:15,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:15,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:15,115 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:15,115 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:54:15,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:15,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:15,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:15,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:15,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:15,117 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 17:54:15,117 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@25683db[Count = 0] remaining members to acquire global barrier 2023-02-13 17:54:15,117 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 17:54:15,117 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:15,118 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:15,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:15,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:15,118 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 17:54:15,118 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-13 17:54:15,118 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:15,119 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:54:15,119 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:54:15,120 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 17:54:15,120 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:15,120 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:15,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:15,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:15,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:15,120 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-13 17:54:15,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:15,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:15,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:15,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:15,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:15,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:15,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:15,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:54:15,122 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 17:54:15,122 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-13 17:54:15,123 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:54:15,123 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:54:15,123 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:15,123 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:54:15,125 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:15,125 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:15,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:15,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:15,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:15,125 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:15,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:15,125 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:15,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:15,125 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:15,125 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:15,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:15,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:15,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:15,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:15,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:15,126 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:15,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:15,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:15,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:15,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:15,129 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:15,129 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:15,129 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:15,129 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:15,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:15,129 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:15,129 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 17:54:15,129 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 17:54:15,129 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:54:15,129 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:15,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:15,129 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:15,129 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:15,129 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:15,129 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:15,129 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 17:54:15,130 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:54:15,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:15,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:15,230 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:54:15,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:54:15,236 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:54:15,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 17:54:15,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:15,238 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 17:54:15,238 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:15,238 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 17:54:15,238 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 17:54:15,238 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:15,238 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:15,240 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:15,240 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:15,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:15,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:15,240 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:15,240 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:54:15,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:15,241 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:15,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:54:15,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:15,241 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:15,242 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 17:54:15,242 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:15,242 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 17:54:15,242 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:15,242 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 17:54:15,242 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:54:15,242 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:54:15,242 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676310849244.e0bf4ad0d89965bdcd22d3ba4d2aebf8. 2023-02-13 17:54:15,242 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676310849244.e0bf4ad0d89965bdcd22d3ba4d2aebf8. started... 2023-02-13 17:54:15,242 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e0bf4ad0d89965bdcd22d3ba4d2aebf8 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 17:54:15,660 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122822808b56f51a46d69b2c7529b7ea926a to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015122822808b56f51a46d69b2c7529b7ea926a 2023-02-13 17:54:15,923 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 17:54:16,066 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/.tmp/family1/448fe416c6964b11a06812fcf0a6e4a8 2023-02-13 17:54:16,074 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/.tmp/family1/448fe416c6964b11a06812fcf0a6e4a8 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/448fe416c6964b11a06812fcf0a6e4a8 2023-02-13 17:54:16,080 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/448fe416c6964b11a06812fcf0a6e4a8, entries=1, sequenceid=21, filesize=4.9 K 2023-02-13 17:54:16,081 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e0bf4ad0d89965bdcd22d3ba4d2aebf8 in 839ms, sequenceid=21, compaction requested=true 2023-02-13 17:54:16,081 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e0bf4ad0d89965bdcd22d3ba4d2aebf8: 2023-02-13 17:54:16,081 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676310849244.e0bf4ad0d89965bdcd22d3ba4d2aebf8. 2023-02-13 17:54:16,082 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:54:16,082 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:54:16,082 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:16,082 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 17:54:16,082 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-13 17:54:16,083 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:16,084 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:16,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:16,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:16,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:16,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:16,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:16,085 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:16,085 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:54:16,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:16,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:16,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:16,086 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 17:54:16,086 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@14ac6ef0[Count = 0] remaining members to acquire global barrier 2023-02-13 17:54:16,086 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 17:54:16,086 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:16,089 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:16,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:16,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:16,089 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 17:54:16,089 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-13 17:54:16,089 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:54:16,089 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:16,089 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:54:16,091 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:16,091 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 17:54:16,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:16,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:16,091 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:16,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:16,091 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-13 17:54:16,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:16,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:16,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:16,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:16,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:16,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:16,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:16,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:54:16,094 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 17:54:16,094 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-13 17:54:16,094 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:54:16,094 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:54:16,094 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:16,094 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:54:16,096 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:16,096 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:16,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:16,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:16,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:16,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:16,096 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:16,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:16,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:16,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:16,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:16,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:16,097 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:16,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:16,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:16,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:16,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:16,098 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:16,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:16,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:16,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:16,101 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:16,101 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:16,101 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:16,101 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:16,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:16,101 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:16,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:16,101 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 17:54:16,101 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:54:16,101 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:16,101 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:16,102 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:16,102 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:16,102 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:16,102 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 17:54:16,102 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:54:16,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:16,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:16,202 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:54:16,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:54:16,208 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:54:16,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 17:54:16,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:16,210 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 17:54:16,210 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:16,210 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 17:54:16,210 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 17:54:16,211 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:16,211 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:16,218 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:16,218 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:16,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:16,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:16,219 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:16,219 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:54:16,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:16,219 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:16,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:54:16,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:16,219 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:16,220 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 17:54:16,220 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:16,220 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 17:54:16,220 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:16,220 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 17:54:16,220 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:54:16,220 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:54:16,220 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676310849244.e0bf4ad0d89965bdcd22d3ba4d2aebf8. 2023-02-13 17:54:16,220 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676310849244.e0bf4ad0d89965bdcd22d3ba4d2aebf8. started... 2023-02-13 17:54:16,220 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e0bf4ad0d89965bdcd22d3ba4d2aebf8 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 17:54:16,635 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512311838fca074d540f2b3061032fe844afe to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512311838fca074d540f2b3061032fe844afe 2023-02-13 17:54:17,041 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/.tmp/family1/bc47ed5733624d47884b0f1a3dee5951 2023-02-13 17:54:17,047 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/.tmp/family1/bc47ed5733624d47884b0f1a3dee5951 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/bc47ed5733624d47884b0f1a3dee5951 2023-02-13 17:54:17,052 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/bc47ed5733624d47884b0f1a3dee5951, entries=1, sequenceid=25, filesize=4.9 K 2023-02-13 17:54:17,053 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e0bf4ad0d89965bdcd22d3ba4d2aebf8 in 833ms, sequenceid=25, compaction requested=true 2023-02-13 17:54:17,053 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e0bf4ad0d89965bdcd22d3ba4d2aebf8: 2023-02-13 17:54:17,053 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676310849244.e0bf4ad0d89965bdcd22d3ba4d2aebf8. 2023-02-13 17:54:17,053 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:54:17,053 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:54:17,053 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:17,053 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 17:54:17,053 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-13 17:54:17,056 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:17,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:17,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:17,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:17,056 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:17,056 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:17,056 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:54:17,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:17,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:17,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:17,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:17,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:17,058 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 17:54:17,058 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5ff9d3d2[Count = 0] remaining members to acquire global barrier 2023-02-13 17:54:17,058 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 17:54:17,059 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:17,061 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:17,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:17,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:17,061 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:17,061 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:54:17,061 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 17:54:17,061 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-13 17:54:17,061 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:54:17,062 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:17,062 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 17:54:17,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:17,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:17,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:17,063 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:17,063 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-13 17:54:17,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:17,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:17,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:17,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:17,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:17,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:17,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:17,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:54:17,066 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 17:54:17,066 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-13 17:54:17,066 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:54:17,066 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:54:17,066 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:17,066 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:54:17,071 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:17,071 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:17,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:17,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:17,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:17,071 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:17,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:17,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:17,071 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:17,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:17,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:17,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:17,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:17,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:17,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:17,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:17,073 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:17,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:17,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:17,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:17,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:17,074 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:17,075 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:17,075 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:17,075 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:17,075 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:17,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:17,075 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:17,075 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 17:54:17,075 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:54:17,075 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:17,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:17,075 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 17:54:17,075 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:17,075 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:17,075 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 17:54:17,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:17,075 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:54:17,075 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:17,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:17,176 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:54:17,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:54:17,181 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:54:17,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 17:54:17,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:17,183 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 17:54:17,183 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:17,183 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 17:54:17,183 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 17:54:17,183 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:17,183 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:17,184 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:17,184 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:17,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:17,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:17,185 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:17,185 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:54:17,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:17,185 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:17,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:54:17,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:17,186 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:17,186 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 17:54:17,186 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:17,186 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 17:54:17,186 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:17,186 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 17:54:17,186 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:54:17,186 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:54:17,186 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676310849244.e0bf4ad0d89965bdcd22d3ba4d2aebf8. 2023-02-13 17:54:17,186 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676310849244.e0bf4ad0d89965bdcd22d3ba4d2aebf8. started... 2023-02-13 17:54:17,186 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e0bf4ad0d89965bdcd22d3ba4d2aebf8 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 17:54:17,601 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101c8d3a6a8ba8e450c8e93734c272c2b92 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101c8d3a6a8ba8e450c8e93734c272c2b92 2023-02-13 17:54:18,007 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/.tmp/family1/92ee63cf7bf544cead6c82c58e9b2554 2023-02-13 17:54:18,013 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/.tmp/family1/92ee63cf7bf544cead6c82c58e9b2554 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/92ee63cf7bf544cead6c82c58e9b2554 2023-02-13 17:54:18,019 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/92ee63cf7bf544cead6c82c58e9b2554, entries=1, sequenceid=29, filesize=4.9 K 2023-02-13 17:54:18,020 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e0bf4ad0d89965bdcd22d3ba4d2aebf8 in 834ms, sequenceid=29, compaction requested=true 2023-02-13 17:54:18,020 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e0bf4ad0d89965bdcd22d3ba4d2aebf8: 2023-02-13 17:54:18,020 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676310849244.e0bf4ad0d89965bdcd22d3ba4d2aebf8. 2023-02-13 17:54:18,020 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:54:18,020 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:54:18,020 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:18,020 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 17:54:18,020 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-13 17:54:18,022 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:18,022 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:18,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:18,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:18,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:18,022 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:18,022 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:54:18,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:18,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:18,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:18,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:18,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:18,024 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 17:54:18,024 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3270008d[Count = 0] remaining members to acquire global barrier 2023-02-13 17:54:18,024 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 17:54:18,024 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:18,029 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:18,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:18,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:18,029 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 17:54:18,029 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-13 17:54:18,029 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:54:18,029 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:18,029 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:54:18,030 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:18,030 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 17:54:18,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:18,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:18,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:18,031 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:18,031 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-13 17:54:18,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:18,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:18,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:18,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:18,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:18,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:18,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:18,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:54:18,034 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 17:54:18,034 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-13 17:54:18,034 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:54:18,034 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:54:18,034 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:18,034 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:54:18,036 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:18,036 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:18,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:18,036 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:18,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:18,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:18,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:18,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:18,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:18,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:18,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:18,037 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:18,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:18,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:18,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:18,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:18,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:18,038 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:18,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:18,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:18,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:18,041 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:18,041 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:18,041 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:18,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:18,041 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:18,041 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:18,041 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:18,041 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 17:54:18,041 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:54:18,041 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:18,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:18,041 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:18,041 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:18,041 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:18,042 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 17:54:18,042 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:54:18,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:18,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:18,142 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:54:18,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:54:18,148 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:54:18,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 17:54:18,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:18,151 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 17:54:18,151 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:18,151 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 17:54:18,151 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 17:54:18,151 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:18,151 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:18,153 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:18,153 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:18,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:18,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:18,154 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:18,154 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:54:18,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:18,154 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:18,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:54:18,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:18,155 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:18,156 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 17:54:18,156 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:18,156 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 17:54:18,156 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:18,156 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 17:54:18,160 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:54:18,160 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:54:18,160 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676310849244.e0bf4ad0d89965bdcd22d3ba4d2aebf8. 2023-02-13 17:54:18,160 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676310849244.e0bf4ad0d89965bdcd22d3ba4d2aebf8. started... 2023-02-13 17:54:18,160 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e0bf4ad0d89965bdcd22d3ba4d2aebf8 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 17:54:18,585 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601038ffd4a68b5e54165ae917d83c08ca758 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601038ffd4a68b5e54165ae917d83c08ca758 2023-02-13 17:54:18,991 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/.tmp/family1/ec941fa882d44ae486cbc8560c77b029 2023-02-13 17:54:18,997 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/.tmp/family1/ec941fa882d44ae486cbc8560c77b029 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/ec941fa882d44ae486cbc8560c77b029 2023-02-13 17:54:19,002 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/ec941fa882d44ae486cbc8560c77b029, entries=1, sequenceid=33, filesize=4.9 K 2023-02-13 17:54:19,003 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e0bf4ad0d89965bdcd22d3ba4d2aebf8 in 843ms, sequenceid=33, compaction requested=true 2023-02-13 17:54:19,003 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e0bf4ad0d89965bdcd22d3ba4d2aebf8: 2023-02-13 17:54:19,003 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676310849244.e0bf4ad0d89965bdcd22d3ba4d2aebf8. 2023-02-13 17:54:19,003 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:54:19,003 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:54:19,003 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:19,003 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 17:54:19,003 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-13 17:54:19,005 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:19,005 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:19,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:19,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:19,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:19,006 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:19,006 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:54:19,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:19,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:19,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:19,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:19,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:19,007 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 17:54:19,007 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@40e1543[Count = 0] remaining members to acquire global barrier 2023-02-13 17:54:19,007 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 17:54:19,007 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:19,009 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:19,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:19,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:19,010 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 17:54:19,010 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-13 17:54:19,010 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:54:19,010 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:19,010 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:54:19,011 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 17:54:19,011 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:19,011 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:19,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:19,011 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-13 17:54:19,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:19,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:19,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:19,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:19,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:19,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:19,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:19,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:19,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:19,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:54:19,013 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 17:54:19,013 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-13 17:54:19,013 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:54:19,013 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:54:19,013 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:19,013 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:54:19,015 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:19,015 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:19,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:19,015 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:19,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:19,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:19,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:19,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:19,015 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:19,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:19,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:19,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:19,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:19,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:19,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:19,016 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:19,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:19,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:19,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:19,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:19,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:19,018 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:19,018 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:19,018 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:19,018 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:19,018 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:19,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:19,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:19,018 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 17:54:19,019 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:54:19,018 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:19,019 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 17:54:19,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:19,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:19,019 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:19,019 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 17:54:19,019 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:54:19,019 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:19,019 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:19,019 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:19,119 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:54:19,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:54:19,125 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:54:19,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 17:54:19,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:19,126 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 17:54:19,126 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:19,126 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 17:54:19,126 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 17:54:19,127 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:19,127 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:19,129 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:19,129 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:19,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:19,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:19,130 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:19,130 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:54:19,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:19,130 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:19,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:54:19,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:19,131 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:19,131 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 17:54:19,131 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:19,131 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 17:54:19,131 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:19,131 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 17:54:19,131 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:54:19,132 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:54:19,132 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676310849244.e0bf4ad0d89965bdcd22d3ba4d2aebf8. 2023-02-13 17:54:19,132 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676310849244.e0bf4ad0d89965bdcd22d3ba4d2aebf8. started... 2023-02-13 17:54:19,132 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e0bf4ad0d89965bdcd22d3ba4d2aebf8 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 17:54:19,547 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090745b424d29b734394a9d7f58c9efde8b0 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015090745b424d29b734394a9d7f58c9efde8b0 2023-02-13 17:54:19,961 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/.tmp/family1/0ea6ce935b8942a3823c1c013969be7a 2023-02-13 17:54:19,967 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/.tmp/family1/0ea6ce935b8942a3823c1c013969be7a as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/0ea6ce935b8942a3823c1c013969be7a 2023-02-13 17:54:19,972 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/0ea6ce935b8942a3823c1c013969be7a, entries=1, sequenceid=37, filesize=4.9 K 2023-02-13 17:54:19,973 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e0bf4ad0d89965bdcd22d3ba4d2aebf8 in 841ms, sequenceid=37, compaction requested=true 2023-02-13 17:54:19,973 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e0bf4ad0d89965bdcd22d3ba4d2aebf8: 2023-02-13 17:54:19,973 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676310849244.e0bf4ad0d89965bdcd22d3ba4d2aebf8. 2023-02-13 17:54:19,974 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:54:19,974 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:54:19,974 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:19,974 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 17:54:19,974 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-13 17:54:19,976 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:19,976 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:19,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:19,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:19,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:19,976 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:19,976 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:54:19,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:19,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:19,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:19,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:19,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:19,978 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 17:54:19,978 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@732220dc[Count = 0] remaining members to acquire global barrier 2023-02-13 17:54:19,978 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 17:54:19,978 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:19,981 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:19,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:19,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:19,981 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 17:54:19,982 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-13 17:54:19,982 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:54:19,982 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:19,982 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:54:19,984 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 17:54:19,984 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:19,984 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:19,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:19,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:19,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:19,984 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-13 17:54:19,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:19,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:19,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:19,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:19,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:19,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:19,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:19,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:54:19,986 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 17:54:19,986 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-13 17:54:19,986 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:54:19,986 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:54:19,986 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:19,986 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:54:19,987 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:19,987 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:19,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:19,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:19,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:19,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:19,988 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:19,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:19,988 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:19,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:19,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:19,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:19,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:19,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:19,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:19,989 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:19,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:19,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:19,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:19,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:19,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:19,991 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:19,991 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:19,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:19,991 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 17:54:19,991 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:54:19,992 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 17:54:19,992 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 17:54:19,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:19,991 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:19,991 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:19,992 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:19,992 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:54:19,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:19,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:19,992 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:19,993 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:19,993 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:19,993 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:19,993 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:20,093 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:54:20,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:54:20,098 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:54:20,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 17:54:20,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:20,100 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 17:54:20,100 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:20,100 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 17:54:20,100 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 17:54:20,100 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:20,100 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:20,102 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:20,102 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:20,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:20,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:20,102 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:20,102 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:54:20,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:20,102 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:20,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:54:20,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:20,103 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:20,103 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 17:54:20,103 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:20,103 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 17:54:20,103 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:20,103 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 17:54:20,103 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:54:20,103 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:54:20,103 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676310849244.e0bf4ad0d89965bdcd22d3ba4d2aebf8. 2023-02-13 17:54:20,103 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676310849244.e0bf4ad0d89965bdcd22d3ba4d2aebf8. started... 2023-02-13 17:54:20,104 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e0bf4ad0d89965bdcd22d3ba4d2aebf8 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 17:54:20,520 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120b237b87387764072bd88097285b5d6e6 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151120b237b87387764072bd88097285b5d6e6 2023-02-13 17:54:20,527 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/.tmp/family1/cbe5bab97377438f8eb55786e61a8946 2023-02-13 17:54:20,533 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/.tmp/family1/cbe5bab97377438f8eb55786e61a8946 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/cbe5bab97377438f8eb55786e61a8946 2023-02-13 17:54:20,538 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/cbe5bab97377438f8eb55786e61a8946, entries=1, sequenceid=41, filesize=4.9 K 2023-02-13 17:54:20,539 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e0bf4ad0d89965bdcd22d3ba4d2aebf8 in 435ms, sequenceid=41, compaction requested=true 2023-02-13 17:54:20,539 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e0bf4ad0d89965bdcd22d3ba4d2aebf8: 2023-02-13 17:54:20,539 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676310849244.e0bf4ad0d89965bdcd22d3ba4d2aebf8. 2023-02-13 17:54:20,539 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:54:20,540 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:54:20,540 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:20,540 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 17:54:20,540 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-13 17:54:20,547 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:20,547 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:20,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:20,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:20,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:20,547 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:20,547 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:54:20,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:20,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:20,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:20,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:20,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:20,549 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 17:54:20,550 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@62541a29[Count = 0] remaining members to acquire global barrier 2023-02-13 17:54:20,550 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 17:54:20,550 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:20,551 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:20,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:20,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:20,551 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:20,551 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:54:20,551 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 17:54:20,551 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-13 17:54:20,551 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:54:20,552 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 17:54:20,552 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:20,552 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:20,552 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-13 17:54:20,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:20,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:20,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:20,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:20,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:20,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:20,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:20,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:20,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:20,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:20,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:54:20,555 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 17:54:20,555 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-13 17:54:20,555 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:54:20,555 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:54:20,555 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:20,556 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:54:20,557 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:20,557 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:20,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:20,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:20,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:20,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:20,557 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:20,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:20,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:20,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:20,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:20,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:20,559 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:20,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:20,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:20,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:20,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:20,560 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:20,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:20,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:20,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:20,563 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:20,563 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:20,563 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:20,563 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:20,563 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 17:54:20,564 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:54:20,563 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 17:54:20,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:20,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:20,563 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:20,564 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:20,564 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:20,564 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 17:54:20,564 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:54:20,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:20,564 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:20,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:20,564 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:20,564 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:20,664 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:54:20,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:54:20,667 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41433] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMinorCompactionWithWeeklyPolicy 2023-02-13 17:54:20,669 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-13 17:54:20,670 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-13 17:54:20,671 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=26, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676311460671 2023-02-13 17:54:20,671 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 17:54:20,674 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-13 17:54:20,675 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 0 del files, 9 selected files, and 0 irrelevant files table 'testMinorCompactionWithWeeklyPolicy' and column 'family1' 2023-02-13 17:54:20,675 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-13 17:54:20,676 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] zookeeper.ReadOnlyZKClient(139): Connect 0x5c367b15 to 127.0.0.1:64825 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 17:54:20,683 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a281341, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 17:54:20,683 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 17:54:21,535 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010325ab1fe4dcdf4094a8a0acbc428538c9 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010325ab1fe4dcdf4094a8a0acbc428538c9 2023-02-13 17:54:21,536 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-13 17:54:21,549 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 17:54:21,551 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59362, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 17:54:21,558 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 17:54:21,560 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58028, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 17:54:21,574 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/de4530607a524e37a85dbb48e01f2c5a first=Optional[r3] last=Optional[r6] 2023-02-13 17:54:21,574 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1676310849244.e0bf4ad0d89965bdcd22d3ba4d2aebf8., hostname=jenkins-hbase4.apache.org,38881,1676310818035, seqNum=2 for row with hfile group [{family1,hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/de4530607a524e37a85dbb48e01f2c5a}] 2023-02-13 17:54:21,579 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(763): Validating hfile at hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/de4530607a524e37a85dbb48e01f2c5a for inclusion in e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1 2023-02-13 17:54:21,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-13 17:54:21,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 17:54:21,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegion(2445): Flush status journal for e0bf4ad0d89965bdcd22d3ba4d2aebf8: 2023-02-13 17:54:21,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/de4530607a524e37a85dbb48e01f2c5a to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMinorCompactionWithWeeklyPolicy__6mkbq6ddfk1ga1sa720er4b2sqg6khb0semlt0h1aoedcv4n88uqiejmk7hr8bif/family1/de4530607a524e37a85dbb48e01f2c5a 2023-02-13 17:54:21,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMinorCompactionWithWeeklyPolicy__6mkbq6ddfk1ga1sa720er4b2sqg6khb0semlt0h1aoedcv4n88uqiejmk7hr8bif/family1/de4530607a524e37a85dbb48e01f2c5a as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/a25917a5c8d8474ba042b5df60aadae0_SeqId_44_ 2023-02-13 17:54:21,588 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(849): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMinorCompactionWithWeeklyPolicy__6mkbq6ddfk1ga1sa720er4b2sqg6khb0semlt0h1aoedcv4n88uqiejmk7hr8bif/family1/de4530607a524e37a85dbb48e01f2c5a into e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/a25917a5c8d8474ba042b5df60aadae0_SeqId_44_ - updating store file list. 2023-02-13 17:54:21,593 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(882): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/a25917a5c8d8474ba042b5df60aadae0_SeqId_44_ into e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1 2023-02-13 17:54:21,593 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(855): Successfully loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMinorCompactionWithWeeklyPolicy__6mkbq6ddfk1ga1sa720er4b2sqg6khb0semlt0h1aoedcv4n88uqiejmk7hr8bif/family1/de4530607a524e37a85dbb48e01f2c5a into e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1 (new location: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/a25917a5c8d8474ba042b5df60aadae0_SeqId_44_) 2023-02-13 17:54:21,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMinorCompactionWithWeeklyPolicy__6mkbq6ddfk1ga1sa720er4b2sqg6khb0semlt0h1aoedcv4n88uqiejmk7hr8bif/family1/de4530607a524e37a85dbb48e01f2c5a 2023-02-13 17:54:21,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-13 17:54:21,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-13 17:54:21,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(1912): e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1 is initiating minor compaction 2023-02-13 17:54:21,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3db51aba; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 17:54:21,598 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1 in testMinorCompactionWithWeeklyPolicy,,1676310849244.e0bf4ad0d89965bdcd22d3ba4d2aebf8. 2023-02-13 17:54:21,598 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/6cf98862c4484af293fedb4d70cc6a80, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/251135e41519440fb2be45d215e50d00, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/0d64bbfac6d746dc9aec674de80d30fb, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/448fe416c6964b11a06812fcf0a6e4a8, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/bc47ed5733624d47884b0f1a3dee5951, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/92ee63cf7bf544cead6c82c58e9b2554, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/ec941fa882d44ae486cbc8560c77b029, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/0ea6ce935b8942a3823c1c013969be7a, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/cbe5bab97377438f8eb55786e61a8946, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/a25917a5c8d8474ba042b5df60aadae0_SeqId_44_] into tmpdir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/.tmp, totalSize=50.0 K 2023-02-13 17:54:21,598 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting 6cf98862c4484af293fedb4d70cc6a80, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-13 17:54:21,598 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting 251135e41519440fb2be45d215e50d00, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-13 17:54:21,598 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting 0d64bbfac6d746dc9aec674de80d30fb, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-13 17:54:21,598 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting 448fe416c6964b11a06812fcf0a6e4a8, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-13 17:54:21,599 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting bc47ed5733624d47884b0f1a3dee5951, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-13 17:54:21,599 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting 92ee63cf7bf544cead6c82c58e9b2554, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-13 17:54:21,599 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting ec941fa882d44ae486cbc8560c77b029, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-13 17:54:21,599 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting 0ea6ce935b8942a3823c1c013969be7a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-13 17:54:21,599 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting cbe5bab97377438f8eb55786e61a8946, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-13 17:54:21,599 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting a25917a5c8d8474ba042b5df60aadae0_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-13 17:54:21,600 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-13 17:54:21,602 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:54:21,604 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015122822808b56f51a46d69b2c7529b7ea926a to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015122822808b56f51a46d69b2c7529b7ea926a 2023-02-13 17:54:21,605 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512311838fca074d540f2b3061032fe844afe to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512311838fca074d540f2b3061032fe844afe 2023-02-13 17:54:21,607 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101c8d3a6a8ba8e450c8e93734c272c2b92 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101c8d3a6a8ba8e450c8e93734c272c2b92 2023-02-13 17:54:21,609 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601038ffd4a68b5e54165ae917d83c08ca758 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601038ffd4a68b5e54165ae917d83c08ca758 2023-02-13 17:54:21,609 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-02-13 17:54:21,609 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-13 17:54:21,609 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 17:54:21,609 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 17:54:21,610 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 17:54:21,610 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 17:54:21,610 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 17:54:21,610 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 17:54:21,610 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 17:54:21,610 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 17:54:21,652 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] throttle.PressureAwareThroughputController(145): e0bf4ad0d89965bdcd22d3ba4d2aebf8#family1#compaction#34 average throughput is 0.23 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 17:54:22,462 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120550409ccd828544bebbd4e6b61e031ed1 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120550409ccd828544bebbd4e6b61e031ed1 2023-02-13 17:54:22,464 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-13 17:54:22,487 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/.tmp/family1/0a1ed72e73bd4a28be883045062dd086 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/0a1ed72e73bd4a28be883045062dd086 2023-02-13 17:54:22,493 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/3d2d500c8e3a4410af98fb8dcfb6b396 first=Optional[r1] last=Optional[r2] 2023-02-13 17:54:22,494 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1676310849244.e0bf4ad0d89965bdcd22d3ba4d2aebf8., hostname=jenkins-hbase4.apache.org,38881,1676310818035, seqNum=2 for row with hfile group [{family1,hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/3d2d500c8e3a4410af98fb8dcfb6b396}] 2023-02-13 17:54:22,495 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1 of e0bf4ad0d89965bdcd22d3ba4d2aebf8 into 0a1ed72e73bd4a28be883045062dd086(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 17:54:22,495 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for e0bf4ad0d89965bdcd22d3ba4d2aebf8: 2023-02-13 17:54:22,497 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1676310849244.e0bf4ad0d89965bdcd22d3ba4d2aebf8., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1676310861597; duration=0sec 2023-02-13 17:54:22,497 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 17:54:22,498 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(763): Validating hfile at hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/3d2d500c8e3a4410af98fb8dcfb6b396 for inclusion in e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1 2023-02-13 17:54:22,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-02-13 17:54:22,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 17:54:22,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegion(2445): Flush status journal for e0bf4ad0d89965bdcd22d3ba4d2aebf8: 2023-02-13 17:54:22,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/3d2d500c8e3a4410af98fb8dcfb6b396 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMinorCompactionWithWeeklyPolicy__21b0dubr5r5b2v9lg8eialr355m3tl112q6tsdccoo2r4ec0ivfhh1krjj5qa742/family1/3d2d500c8e3a4410af98fb8dcfb6b396 2023-02-13 17:54:22,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMinorCompactionWithWeeklyPolicy__21b0dubr5r5b2v9lg8eialr355m3tl112q6tsdccoo2r4ec0ivfhh1krjj5qa742/family1/3d2d500c8e3a4410af98fb8dcfb6b396 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/b4a33ec81fd744f9961663ac0c1c47e4_SeqId_47_ 2023-02-13 17:54:22,505 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(849): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMinorCompactionWithWeeklyPolicy__21b0dubr5r5b2v9lg8eialr355m3tl112q6tsdccoo2r4ec0ivfhh1krjj5qa742/family1/3d2d500c8e3a4410af98fb8dcfb6b396 into e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/b4a33ec81fd744f9961663ac0c1c47e4_SeqId_47_ - updating store file list. 2023-02-13 17:54:22,510 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(882): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/b4a33ec81fd744f9961663ac0c1c47e4_SeqId_47_ into e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1 2023-02-13 17:54:22,510 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(855): Successfully loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMinorCompactionWithWeeklyPolicy__21b0dubr5r5b2v9lg8eialr355m3tl112q6tsdccoo2r4ec0ivfhh1krjj5qa742/family1/3d2d500c8e3a4410af98fb8dcfb6b396 into e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1 (new location: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/b4a33ec81fd744f9961663ac0c1c47e4_SeqId_47_) 2023-02-13 17:54:22,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMinorCompactionWithWeeklyPolicy__21b0dubr5r5b2v9lg8eialr355m3tl112q6tsdccoo2r4ec0ivfhh1krjj5qa742/family1/3d2d500c8e3a4410af98fb8dcfb6b396 2023-02-13 17:54:22,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-13 17:54:22,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 181014 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-13 17:54:22,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(1912): e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1 is initiating minor compaction (all files) 2023-02-13 17:54:22,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1a6f3b6b; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 17:54:22,512 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1 in testMinorCompactionWithWeeklyPolicy,,1676310849244.e0bf4ad0d89965bdcd22d3ba4d2aebf8. 2023-02-13 17:54:22,512 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/49f51d1bdf5a4d2998bee0d1ba69b7ec, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/0a1ed72e73bd4a28be883045062dd086, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/b4a33ec81fd744f9961663ac0c1c47e4_SeqId_47_] into tmpdir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/.tmp, totalSize=176.8 K 2023-02-13 17:54:22,513 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting 49f51d1bdf5a4d2998bee0d1ba69b7ec, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878841551 2023-02-13 17:54:22,513 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting 0a1ed72e73bd4a28be883045062dd086, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621241551 2023-02-13 17:54:22,514 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting b4a33ec81fd744f9961663ac0c1c47e4_SeqId_47_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965241551 2023-02-13 17:54:22,514 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-13 17:54:22,515 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:54:22,518 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512013910d17dfbb04be3a56931e8333b2414 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512013910d17dfbb04be3a56931e8333b2414 2023-02-13 17:54:22,519 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205abe51f85476c428eab9bc1346daf9443 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205abe51f85476c428eab9bc1346daf9443 2023-02-13 17:54:22,519 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 2 expired mob files are deleted 2023-02-13 17:54:22,520 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-13 17:54:22,520 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 17:54:22,520 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-13 17:54:22,520 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 17:54:22,522 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=26, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-13 17:54:22,524 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.8540 sec 2023-02-13 17:54:22,540 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] throttle.PressureAwareThroughputController(145): e0bf4ad0d89965bdcd22d3ba4d2aebf8#family1#compaction#35 average throughput is 10.31 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 17:54:22,569 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/6cf98862c4484af293fedb4d70cc6a80, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/251135e41519440fb2be45d215e50d00, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/0d64bbfac6d746dc9aec674de80d30fb, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/448fe416c6964b11a06812fcf0a6e4a8, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/bc47ed5733624d47884b0f1a3dee5951, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/92ee63cf7bf544cead6c82c58e9b2554, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/ec941fa882d44ae486cbc8560c77b029, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/0ea6ce935b8942a3823c1c013969be7a, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/cbe5bab97377438f8eb55786e61a8946, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/a25917a5c8d8474ba042b5df60aadae0_SeqId_44_] to archive 2023-02-13 17:54:22,570 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:54:22,573 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/6cf98862c4484af293fedb4d70cc6a80 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/6cf98862c4484af293fedb4d70cc6a80 2023-02-13 17:54:22,575 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/251135e41519440fb2be45d215e50d00 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/251135e41519440fb2be45d215e50d00 2023-02-13 17:54:22,576 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/0d64bbfac6d746dc9aec674de80d30fb to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/0d64bbfac6d746dc9aec674de80d30fb 2023-02-13 17:54:22,578 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/448fe416c6964b11a06812fcf0a6e4a8 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/448fe416c6964b11a06812fcf0a6e4a8 2023-02-13 17:54:22,580 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/bc47ed5733624d47884b0f1a3dee5951 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/bc47ed5733624d47884b0f1a3dee5951 2023-02-13 17:54:22,584 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/92ee63cf7bf544cead6c82c58e9b2554 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/92ee63cf7bf544cead6c82c58e9b2554 2023-02-13 17:54:22,589 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/ec941fa882d44ae486cbc8560c77b029 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/ec941fa882d44ae486cbc8560c77b029 2023-02-13 17:54:22,590 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/0ea6ce935b8942a3823c1c013969be7a to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/0ea6ce935b8942a3823c1c013969be7a 2023-02-13 17:54:22,592 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/cbe5bab97377438f8eb55786e61a8946 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/cbe5bab97377438f8eb55786e61a8946 2023-02-13 17:54:22,596 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/a25917a5c8d8474ba042b5df60aadae0_SeqId_44_ to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/a25917a5c8d8474ba042b5df60aadae0_SeqId_44_ 2023-02-13 17:54:22,655 INFO [Listener at localhost/35343] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=261 (was 254) - Thread LEAK? -, OpenFileDescriptor=623 (was 612) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=264 (was 299), ProcessCount=168 (was 168), AvailableMemoryMB=1482 (was 1858) 2023-02-13 17:54:22,669 INFO [Listener at localhost/35343] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=261, OpenFileDescriptor=623, MaxFileDescriptor=60000, SystemLoadAverage=264, ProcessCount=168, AvailableMemoryMB=1479 2023-02-13 17:54:22,672 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-13 17:54:22,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:22,675 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 17:54:22,675 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testScannerOnBulkLoadRefHFiles" procId is: 27 2023-02-13 17:54:22,676 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 17:54:22,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-13 17:54:22,679 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testScannerOnBulkLoadRefHFiles/e21ab587bd90d22ef3de7b8eb89e7b53 2023-02-13 17:54:22,679 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testScannerOnBulkLoadRefHFiles/ac0d738464f62c71a828e94f1b2c219e 2023-02-13 17:54:22,679 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testScannerOnBulkLoadRefHFiles/d8c03018eab4e6ef28148efb7a566098 2023-02-13 17:54:22,680 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testScannerOnBulkLoadRefHFiles/e21ab587bd90d22ef3de7b8eb89e7b53 empty. 2023-02-13 17:54:22,680 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testScannerOnBulkLoadRefHFiles/ac0d738464f62c71a828e94f1b2c219e empty. 2023-02-13 17:54:22,680 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testScannerOnBulkLoadRefHFiles/d8c03018eab4e6ef28148efb7a566098 empty. 2023-02-13 17:54:22,680 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testScannerOnBulkLoadRefHFiles/e21ab587bd90d22ef3de7b8eb89e7b53 2023-02-13 17:54:22,680 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testScannerOnBulkLoadRefHFiles/ac0d738464f62c71a828e94f1b2c219e 2023-02-13 17:54:22,681 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testScannerOnBulkLoadRefHFiles/d8c03018eab4e6ef28148efb7a566098 2023-02-13 17:54:22,681 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testScannerOnBulkLoadRefHFiles regions 2023-02-13 17:54:22,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-13 17:54:22,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-13 17:54:23,091 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testScannerOnBulkLoadRefHFiles/.tabledesc/.tableinfo.0000000001 2023-02-13 17:54:23,093 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(7671): creating {ENCODED => e21ab587bd90d22ef3de7b8eb89e7b53, NAME => 'testScannerOnBulkLoadRefHFiles,,1676310862672.e21ab587bd90d22ef3de7b8eb89e7b53.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp 2023-02-13 17:54:23,094 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(7671): creating {ENCODED => d8c03018eab4e6ef28148efb7a566098, NAME => 'testScannerOnBulkLoadRefHFiles,2,1676310862672.d8c03018eab4e6ef28148efb7a566098.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp 2023-02-13 17:54:23,094 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(7671): creating {ENCODED => ac0d738464f62c71a828e94f1b2c219e, NAME => 'testScannerOnBulkLoadRefHFiles,1,1676310862672.ac0d738464f62c71a828e94f1b2c219e.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp 2023-02-13 17:54:23,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-13 17:54:23,364 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/.tmp/family1/7f08edad423d420d8b118f5842a82267 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/7f08edad423d420d8b118f5842a82267 2023-02-13 17:54:23,371 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1 of e0bf4ad0d89965bdcd22d3ba4d2aebf8 into 7f08edad423d420d8b118f5842a82267(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 17:54:23,371 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for e0bf4ad0d89965bdcd22d3ba4d2aebf8: 2023-02-13 17:54:23,372 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1676310849244.e0bf4ad0d89965bdcd22d3ba4d2aebf8., storeName=family1, fileCount=3, fileSize=176.8 K (165.1 K, 6.6 K, 5.2 K), priority=2, time=1676310862512; duration=0sec 2023-02-13 17:54:23,372 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 17:54:23,459 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/49f51d1bdf5a4d2998bee0d1ba69b7ec, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/0a1ed72e73bd4a28be883045062dd086, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/b4a33ec81fd744f9961663ac0c1c47e4_SeqId_47_] to archive 2023-02-13 17:54:23,460 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:54:23,463 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/49f51d1bdf5a4d2998bee0d1ba69b7ec to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/49f51d1bdf5a4d2998bee0d1ba69b7ec 2023-02-13 17:54:23,464 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/0a1ed72e73bd4a28be883045062dd086 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/0a1ed72e73bd4a28be883045062dd086 2023-02-13 17:54:23,466 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/b4a33ec81fd744f9961663ac0c1c47e4_SeqId_47_ to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/family1/b4a33ec81fd744f9961663ac0c1c47e4_SeqId_47_ 2023-02-13 17:54:23,509 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,2,1676310862672.d8c03018eab4e6ef28148efb7a566098.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 17:54:23,509 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1603): Closing d8c03018eab4e6ef28148efb7a566098, disabling compactions & flushes 2023-02-13 17:54:23,509 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,2,1676310862672.d8c03018eab4e6ef28148efb7a566098. 2023-02-13 17:54:23,510 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1676310862672.d8c03018eab4e6ef28148efb7a566098. 2023-02-13 17:54:23,510 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1676310862672.d8c03018eab4e6ef28148efb7a566098. after waiting 0 ms 2023-02-13 17:54:23,510 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1676310862672.d8c03018eab4e6ef28148efb7a566098. 2023-02-13 17:54:23,510 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,2,1676310862672.d8c03018eab4e6ef28148efb7a566098. 2023-02-13 17:54:23,510 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1557): Region close journal for d8c03018eab4e6ef28148efb7a566098: Waiting for close lock at 1676310863509Disabling compacts and flushes for region at 1676310863509Disabling writes for close at 1676310863510 (+1 ms)Writing region close event to WAL at 1676310863510Closed at 1676310863510 2023-02-13 17:54:23,510 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,,1676310862672.e21ab587bd90d22ef3de7b8eb89e7b53.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 17:54:23,510 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1603): Closing e21ab587bd90d22ef3de7b8eb89e7b53, disabling compactions & flushes 2023-02-13 17:54:23,510 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,,1676310862672.e21ab587bd90d22ef3de7b8eb89e7b53. 2023-02-13 17:54:23,510 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1676310862672.e21ab587bd90d22ef3de7b8eb89e7b53. 2023-02-13 17:54:23,510 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1676310862672.e21ab587bd90d22ef3de7b8eb89e7b53. after waiting 0 ms 2023-02-13 17:54:23,510 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1676310862672.e21ab587bd90d22ef3de7b8eb89e7b53. 2023-02-13 17:54:23,510 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,,1676310862672.e21ab587bd90d22ef3de7b8eb89e7b53. 2023-02-13 17:54:23,510 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1557): Region close journal for e21ab587bd90d22ef3de7b8eb89e7b53: Waiting for close lock at 1676310863510Disabling compacts and flushes for region at 1676310863510Disabling writes for close at 1676310863510Writing region close event to WAL at 1676310863510Closed at 1676310863510 2023-02-13 17:54:23,512 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,1,1676310862672.ac0d738464f62c71a828e94f1b2c219e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 17:54:23,512 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1603): Closing ac0d738464f62c71a828e94f1b2c219e, disabling compactions & flushes 2023-02-13 17:54:23,512 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,1,1676310862672.ac0d738464f62c71a828e94f1b2c219e. 2023-02-13 17:54:23,512 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1676310862672.ac0d738464f62c71a828e94f1b2c219e. 2023-02-13 17:54:23,512 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1676310862672.ac0d738464f62c71a828e94f1b2c219e. after waiting 0 ms 2023-02-13 17:54:23,512 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1676310862672.ac0d738464f62c71a828e94f1b2c219e. 2023-02-13 17:54:23,512 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,1,1676310862672.ac0d738464f62c71a828e94f1b2c219e. 2023-02-13 17:54:23,512 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1557): Region close journal for ac0d738464f62c71a828e94f1b2c219e: Waiting for close lock at 1676310863512Disabling compacts and flushes for region at 1676310863512Disabling writes for close at 1676310863512Writing region close event to WAL at 1676310863512Closed at 1676310863512 2023-02-13 17:54:23,515 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 17:54:23,516 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,2,1676310862672.d8c03018eab4e6ef28148efb7a566098.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1676310863516"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676310863516"}]},"ts":"1676310863516"} 2023-02-13 17:54:23,516 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,,1676310862672.e21ab587bd90d22ef3de7b8eb89e7b53.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1676310863516"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676310863516"}]},"ts":"1676310863516"} 2023-02-13 17:54:23,516 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,1,1676310862672.ac0d738464f62c71a828e94f1b2c219e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1676310863516"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676310863516"}]},"ts":"1676310863516"} 2023-02-13 17:54:23,519 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-13 17:54:23,520 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 17:54:23,520 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676310863520"}]},"ts":"1676310863520"} 2023-02-13 17:54:23,522 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLING in hbase:meta 2023-02-13 17:54:23,525 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=e21ab587bd90d22ef3de7b8eb89e7b53, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=ac0d738464f62c71a828e94f1b2c219e, ASSIGN}, {pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=d8c03018eab4e6ef28148efb7a566098, ASSIGN}] 2023-02-13 17:54:23,526 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=e21ab587bd90d22ef3de7b8eb89e7b53, ASSIGN 2023-02-13 17:54:23,527 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=ac0d738464f62c71a828e94f1b2c219e, ASSIGN 2023-02-13 17:54:23,527 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=d8c03018eab4e6ef28148efb7a566098, ASSIGN 2023-02-13 17:54:23,527 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=e21ab587bd90d22ef3de7b8eb89e7b53, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38881,1676310818035; forceNewPlan=false, retain=false 2023-02-13 17:54:23,527 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=ac0d738464f62c71a828e94f1b2c219e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38881,1676310818035; forceNewPlan=false, retain=false 2023-02-13 17:54:23,528 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=d8c03018eab4e6ef28148efb7a566098, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38881,1676310818035; forceNewPlan=false, retain=false 2023-02-13 17:54:23,679 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=e21ab587bd90d22ef3de7b8eb89e7b53, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:23,679 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=d8c03018eab4e6ef28148efb7a566098, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:23,679 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=ac0d738464f62c71a828e94f1b2c219e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:23,680 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,,1676310862672.e21ab587bd90d22ef3de7b8eb89e7b53.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1676310863679"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676310863679"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676310863679"}]},"ts":"1676310863679"} 2023-02-13 17:54:23,680 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,2,1676310862672.d8c03018eab4e6ef28148efb7a566098.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1676310863679"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676310863679"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676310863679"}]},"ts":"1676310863679"} 2023-02-13 17:54:23,680 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,1,1676310862672.ac0d738464f62c71a828e94f1b2c219e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1676310863679"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676310863679"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676310863679"}]},"ts":"1676310863679"} 2023-02-13 17:54:23,682 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure e21ab587bd90d22ef3de7b8eb89e7b53, server=jenkins-hbase4.apache.org,38881,1676310818035}] 2023-02-13 17:54:23,683 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=32, ppid=30, state=RUNNABLE; OpenRegionProcedure d8c03018eab4e6ef28148efb7a566098, server=jenkins-hbase4.apache.org,38881,1676310818035}] 2023-02-13 17:54:23,683 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=33, ppid=29, state=RUNNABLE; OpenRegionProcedure ac0d738464f62c71a828e94f1b2c219e, server=jenkins-hbase4.apache.org,38881,1676310818035}] 2023-02-13 17:54:23,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-13 17:54:23,837 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,,1676310862672.e21ab587bd90d22ef3de7b8eb89e7b53. 2023-02-13 17:54:23,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e21ab587bd90d22ef3de7b8eb89e7b53, NAME => 'testScannerOnBulkLoadRefHFiles,,1676310862672.e21ab587bd90d22ef3de7b8eb89e7b53.', STARTKEY => '', ENDKEY => '1'} 2023-02-13 17:54:23,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles e21ab587bd90d22ef3de7b8eb89e7b53 2023-02-13 17:54:23,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,,1676310862672.e21ab587bd90d22ef3de7b8eb89e7b53.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 17:54:23,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e21ab587bd90d22ef3de7b8eb89e7b53 2023-02-13 17:54:23,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e21ab587bd90d22ef3de7b8eb89e7b53 2023-02-13 17:54:23,839 INFO [StoreOpener-e21ab587bd90d22ef3de7b8eb89e7b53-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e21ab587bd90d22ef3de7b8eb89e7b53 2023-02-13 17:54:23,840 DEBUG [StoreOpener-e21ab587bd90d22ef3de7b8eb89e7b53-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testScannerOnBulkLoadRefHFiles/e21ab587bd90d22ef3de7b8eb89e7b53/family1 2023-02-13 17:54:23,840 DEBUG [StoreOpener-e21ab587bd90d22ef3de7b8eb89e7b53-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testScannerOnBulkLoadRefHFiles/e21ab587bd90d22ef3de7b8eb89e7b53/family1 2023-02-13 17:54:23,841 INFO [StoreOpener-e21ab587bd90d22ef3de7b8eb89e7b53-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e21ab587bd90d22ef3de7b8eb89e7b53 columnFamilyName family1 2023-02-13 17:54:23,842 INFO [StoreOpener-e21ab587bd90d22ef3de7b8eb89e7b53-1] regionserver.HStore(310): Store=e21ab587bd90d22ef3de7b8eb89e7b53/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 17:54:23,842 INFO [StoreOpener-e21ab587bd90d22ef3de7b8eb89e7b53-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region e21ab587bd90d22ef3de7b8eb89e7b53 2023-02-13 17:54:23,844 DEBUG [StoreOpener-e21ab587bd90d22ef3de7b8eb89e7b53-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testScannerOnBulkLoadRefHFiles/e21ab587bd90d22ef3de7b8eb89e7b53/family2 2023-02-13 17:54:23,844 DEBUG [StoreOpener-e21ab587bd90d22ef3de7b8eb89e7b53-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testScannerOnBulkLoadRefHFiles/e21ab587bd90d22ef3de7b8eb89e7b53/family2 2023-02-13 17:54:23,844 INFO [StoreOpener-e21ab587bd90d22ef3de7b8eb89e7b53-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e21ab587bd90d22ef3de7b8eb89e7b53 columnFamilyName family2 2023-02-13 17:54:23,845 INFO [StoreOpener-e21ab587bd90d22ef3de7b8eb89e7b53-1] regionserver.HStore(310): Store=e21ab587bd90d22ef3de7b8eb89e7b53/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 17:54:23,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testScannerOnBulkLoadRefHFiles/e21ab587bd90d22ef3de7b8eb89e7b53 2023-02-13 17:54:23,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testScannerOnBulkLoadRefHFiles/e21ab587bd90d22ef3de7b8eb89e7b53 2023-02-13 17:54:23,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 17:54:23,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e21ab587bd90d22ef3de7b8eb89e7b53 2023-02-13 17:54:23,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testScannerOnBulkLoadRefHFiles/e21ab587bd90d22ef3de7b8eb89e7b53/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 17:54:23,854 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e21ab587bd90d22ef3de7b8eb89e7b53; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61130618, jitterRate=-0.08908280730247498}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 17:54:23,855 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e21ab587bd90d22ef3de7b8eb89e7b53: Running coprocessor pre-open hook at 1676310863838Writing region info on filesystem at 1676310863838Initializing all the Stores at 1676310863839 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676310863839Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676310863839Cleaning up temporary data from old regions at 1676310863847 (+8 ms)Cleaning up detritus from prior splits at 1676310863848 (+1 ms)Running coprocessor post-open hooks at 1676310863855 (+7 ms)Region opened successfully at 1676310863855 2023-02-13 17:54:23,856 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,,1676310862672.e21ab587bd90d22ef3de7b8eb89e7b53., pid=31, masterSystemTime=1676310863834 2023-02-13 17:54:23,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,,1676310862672.e21ab587bd90d22ef3de7b8eb89e7b53. 2023-02-13 17:54:23,858 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,,1676310862672.e21ab587bd90d22ef3de7b8eb89e7b53. 2023-02-13 17:54:23,858 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,2,1676310862672.d8c03018eab4e6ef28148efb7a566098. 2023-02-13 17:54:23,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d8c03018eab4e6ef28148efb7a566098, NAME => 'testScannerOnBulkLoadRefHFiles,2,1676310862672.d8c03018eab4e6ef28148efb7a566098.', STARTKEY => '2', ENDKEY => ''} 2023-02-13 17:54:23,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles d8c03018eab4e6ef28148efb7a566098 2023-02-13 17:54:23,858 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=e21ab587bd90d22ef3de7b8eb89e7b53, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:23,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,2,1676310862672.d8c03018eab4e6ef28148efb7a566098.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 17:54:23,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for d8c03018eab4e6ef28148efb7a566098 2023-02-13 17:54:23,859 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,,1676310862672.e21ab587bd90d22ef3de7b8eb89e7b53.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1676310863858"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676310863858"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676310863858"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676310863858"}]},"ts":"1676310863858"} 2023-02-13 17:54:23,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for d8c03018eab4e6ef28148efb7a566098 2023-02-13 17:54:23,860 INFO [StoreOpener-d8c03018eab4e6ef28148efb7a566098-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region d8c03018eab4e6ef28148efb7a566098 2023-02-13 17:54:23,861 DEBUG [StoreOpener-d8c03018eab4e6ef28148efb7a566098-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testScannerOnBulkLoadRefHFiles/d8c03018eab4e6ef28148efb7a566098/family1 2023-02-13 17:54:23,862 DEBUG [StoreOpener-d8c03018eab4e6ef28148efb7a566098-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testScannerOnBulkLoadRefHFiles/d8c03018eab4e6ef28148efb7a566098/family1 2023-02-13 17:54:23,862 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-02-13 17:54:23,862 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure e21ab587bd90d22ef3de7b8eb89e7b53, server=jenkins-hbase4.apache.org,38881,1676310818035 in 178 msec 2023-02-13 17:54:23,862 INFO [StoreOpener-d8c03018eab4e6ef28148efb7a566098-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d8c03018eab4e6ef28148efb7a566098 columnFamilyName family1 2023-02-13 17:54:23,863 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=e21ab587bd90d22ef3de7b8eb89e7b53, ASSIGN in 337 msec 2023-02-13 17:54:23,863 INFO [StoreOpener-d8c03018eab4e6ef28148efb7a566098-1] regionserver.HStore(310): Store=d8c03018eab4e6ef28148efb7a566098/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 17:54:23,864 INFO [StoreOpener-d8c03018eab4e6ef28148efb7a566098-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region d8c03018eab4e6ef28148efb7a566098 2023-02-13 17:54:23,865 DEBUG [StoreOpener-d8c03018eab4e6ef28148efb7a566098-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testScannerOnBulkLoadRefHFiles/d8c03018eab4e6ef28148efb7a566098/family2 2023-02-13 17:54:23,865 DEBUG [StoreOpener-d8c03018eab4e6ef28148efb7a566098-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testScannerOnBulkLoadRefHFiles/d8c03018eab4e6ef28148efb7a566098/family2 2023-02-13 17:54:23,866 INFO [StoreOpener-d8c03018eab4e6ef28148efb7a566098-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d8c03018eab4e6ef28148efb7a566098 columnFamilyName family2 2023-02-13 17:54:23,867 INFO [StoreOpener-d8c03018eab4e6ef28148efb7a566098-1] regionserver.HStore(310): Store=d8c03018eab4e6ef28148efb7a566098/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 17:54:23,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testScannerOnBulkLoadRefHFiles/d8c03018eab4e6ef28148efb7a566098 2023-02-13 17:54:23,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testScannerOnBulkLoadRefHFiles/d8c03018eab4e6ef28148efb7a566098 2023-02-13 17:54:23,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 17:54:23,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for d8c03018eab4e6ef28148efb7a566098 2023-02-13 17:54:23,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testScannerOnBulkLoadRefHFiles/d8c03018eab4e6ef28148efb7a566098/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 17:54:23,872 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened d8c03018eab4e6ef28148efb7a566098; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74954077, jitterRate=0.11690278351306915}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 17:54:23,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for d8c03018eab4e6ef28148efb7a566098: Running coprocessor pre-open hook at 1676310863859Writing region info on filesystem at 1676310863859Initializing all the Stores at 1676310863860 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676310863860Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676310863860Cleaning up temporary data from old regions at 1676310863869 (+9 ms)Cleaning up detritus from prior splits at 1676310863869Running coprocessor post-open hooks at 1676310863873 (+4 ms)Region opened successfully at 1676310863873 2023-02-13 17:54:23,873 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,2,1676310862672.d8c03018eab4e6ef28148efb7a566098., pid=32, masterSystemTime=1676310863834 2023-02-13 17:54:23,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,2,1676310862672.d8c03018eab4e6ef28148efb7a566098. 2023-02-13 17:54:23,875 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,2,1676310862672.d8c03018eab4e6ef28148efb7a566098. 2023-02-13 17:54:23,875 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,1,1676310862672.ac0d738464f62c71a828e94f1b2c219e. 2023-02-13 17:54:23,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ac0d738464f62c71a828e94f1b2c219e, NAME => 'testScannerOnBulkLoadRefHFiles,1,1676310862672.ac0d738464f62c71a828e94f1b2c219e.', STARTKEY => '1', ENDKEY => '2'} 2023-02-13 17:54:23,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles ac0d738464f62c71a828e94f1b2c219e 2023-02-13 17:54:23,875 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=d8c03018eab4e6ef28148efb7a566098, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:23,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,1,1676310862672.ac0d738464f62c71a828e94f1b2c219e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 17:54:23,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ac0d738464f62c71a828e94f1b2c219e 2023-02-13 17:54:23,876 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,2,1676310862672.d8c03018eab4e6ef28148efb7a566098.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1676310863875"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676310863875"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676310863875"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676310863875"}]},"ts":"1676310863875"} 2023-02-13 17:54:23,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ac0d738464f62c71a828e94f1b2c219e 2023-02-13 17:54:23,878 INFO [StoreOpener-ac0d738464f62c71a828e94f1b2c219e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ac0d738464f62c71a828e94f1b2c219e 2023-02-13 17:54:23,879 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=32, resume processing ppid=30 2023-02-13 17:54:23,879 DEBUG [StoreOpener-ac0d738464f62c71a828e94f1b2c219e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testScannerOnBulkLoadRefHFiles/ac0d738464f62c71a828e94f1b2c219e/family1 2023-02-13 17:54:23,879 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=32, ppid=30, state=SUCCESS; OpenRegionProcedure d8c03018eab4e6ef28148efb7a566098, server=jenkins-hbase4.apache.org,38881,1676310818035 in 194 msec 2023-02-13 17:54:23,879 DEBUG [StoreOpener-ac0d738464f62c71a828e94f1b2c219e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testScannerOnBulkLoadRefHFiles/ac0d738464f62c71a828e94f1b2c219e/family1 2023-02-13 17:54:23,880 INFO [StoreOpener-ac0d738464f62c71a828e94f1b2c219e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ac0d738464f62c71a828e94f1b2c219e columnFamilyName family1 2023-02-13 17:54:23,881 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=d8c03018eab4e6ef28148efb7a566098, ASSIGN in 354 msec 2023-02-13 17:54:23,881 INFO [StoreOpener-ac0d738464f62c71a828e94f1b2c219e-1] regionserver.HStore(310): Store=ac0d738464f62c71a828e94f1b2c219e/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 17:54:23,881 INFO [StoreOpener-ac0d738464f62c71a828e94f1b2c219e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region ac0d738464f62c71a828e94f1b2c219e 2023-02-13 17:54:23,883 DEBUG [StoreOpener-ac0d738464f62c71a828e94f1b2c219e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testScannerOnBulkLoadRefHFiles/ac0d738464f62c71a828e94f1b2c219e/family2 2023-02-13 17:54:23,883 DEBUG [StoreOpener-ac0d738464f62c71a828e94f1b2c219e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testScannerOnBulkLoadRefHFiles/ac0d738464f62c71a828e94f1b2c219e/family2 2023-02-13 17:54:23,883 INFO [StoreOpener-ac0d738464f62c71a828e94f1b2c219e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ac0d738464f62c71a828e94f1b2c219e columnFamilyName family2 2023-02-13 17:54:23,884 INFO [StoreOpener-ac0d738464f62c71a828e94f1b2c219e-1] regionserver.HStore(310): Store=ac0d738464f62c71a828e94f1b2c219e/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 17:54:23,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testScannerOnBulkLoadRefHFiles/ac0d738464f62c71a828e94f1b2c219e 2023-02-13 17:54:23,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testScannerOnBulkLoadRefHFiles/ac0d738464f62c71a828e94f1b2c219e 2023-02-13 17:54:23,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 17:54:23,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ac0d738464f62c71a828e94f1b2c219e 2023-02-13 17:54:23,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testScannerOnBulkLoadRefHFiles/ac0d738464f62c71a828e94f1b2c219e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 17:54:23,890 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ac0d738464f62c71a828e94f1b2c219e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71724591, jitterRate=0.06877969205379486}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 17:54:23,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ac0d738464f62c71a828e94f1b2c219e: Running coprocessor pre-open hook at 1676310863876Writing region info on filesystem at 1676310863876Initializing all the Stores at 1676310863877 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676310863878 (+1 ms)Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676310863878Cleaning up temporary data from old regions at 1676310863886 (+8 ms)Cleaning up detritus from prior splits at 1676310863886Running coprocessor post-open hooks at 1676310863890 (+4 ms)Region opened successfully at 1676310863890 2023-02-13 17:54:23,891 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,1,1676310862672.ac0d738464f62c71a828e94f1b2c219e., pid=33, masterSystemTime=1676310863834 2023-02-13 17:54:23,892 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,1,1676310862672.ac0d738464f62c71a828e94f1b2c219e. 2023-02-13 17:54:23,892 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,1,1676310862672.ac0d738464f62c71a828e94f1b2c219e. 2023-02-13 17:54:23,893 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=ac0d738464f62c71a828e94f1b2c219e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:23,893 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,1,1676310862672.ac0d738464f62c71a828e94f1b2c219e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1676310863892"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676310863892"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676310863892"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676310863892"}]},"ts":"1676310863892"} 2023-02-13 17:54:23,896 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=33, resume processing ppid=29 2023-02-13 17:54:23,896 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=33, ppid=29, state=SUCCESS; OpenRegionProcedure ac0d738464f62c71a828e94f1b2c219e, server=jenkins-hbase4.apache.org,38881,1676310818035 in 211 msec 2023-02-13 17:54:23,897 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=27 2023-02-13 17:54:23,898 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=ac0d738464f62c71a828e94f1b2c219e, ASSIGN in 371 msec 2023-02-13 17:54:23,898 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 17:54:23,898 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676310863898"}]},"ts":"1676310863898"} 2023-02-13 17:54:23,899 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLED in hbase:meta 2023-02-13 17:54:23,902 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 17:54:23,903 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles in 1.2300 sec 2023-02-13 17:54:24,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-13 17:54:24,782 INFO [Listener at localhost/35343] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testScannerOnBulkLoadRefHFiles, procId: 27 completed 2023-02-13 17:54:24,791 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:54:24,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:24,793 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-02-13 17:54:24,793 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:24,793 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-02-13 17:54:24,793 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-02-13 17:54:24,794 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:24,794 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:24,795 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:24,795 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:24,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:24,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:24,796 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:24,796 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:54:24,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:24,796 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:24,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:54:24,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:24,797 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:24,797 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:24,797 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-02-13 17:54:24,797 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:24,797 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-02-13 17:54:24,797 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1676310862672.ac0d738464f62c71a828e94f1b2c219e. 2023-02-13 17:54:24,797 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1676310862672.ac0d738464f62c71a828e94f1b2c219e. started... 2023-02-13 17:54:24,798 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1676310862672.d8c03018eab4e6ef28148efb7a566098. 2023-02-13 17:54:24,798 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1676310862672.d8c03018eab4e6ef28148efb7a566098. started... 2023-02-13 17:54:24,798 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 17:54:24,798 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for ac0d738464f62c71a828e94f1b2c219e: 2023-02-13 17:54:24,799 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing d8c03018eab4e6ef28148efb7a566098 2/2 column families, dataSize=48 B heapSize=632 B 2023-02-13 17:54:24,799 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1676310862672.e21ab587bd90d22ef3de7b8eb89e7b53. 2023-02-13 17:54:24,799 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:54:24,799 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1676310862672.e21ab587bd90d22ef3de7b8eb89e7b53. started... 2023-02-13 17:54:24,799 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1676310862672.ac0d738464f62c71a828e94f1b2c219e. 2023-02-13 17:54:24,800 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for e21ab587bd90d22ef3de7b8eb89e7b53: 2023-02-13 17:54:24,800 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 17:54:24,800 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1676310862672.e21ab587bd90d22ef3de7b8eb89e7b53. 2023-02-13 17:54:24,800 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 17:54:24,818 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213bfe32e41162f4f02b4d24130319b0bf6 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230213bfe32e41162f4f02b4d24130319b0bf6 2023-02-13 17:54:24,824 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=48, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testScannerOnBulkLoadRefHFiles/d8c03018eab4e6ef28148efb7a566098/.tmp/family1/de22395b31c746cb8875b37d736ad9c3 2023-02-13 17:54:24,831 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testScannerOnBulkLoadRefHFiles/d8c03018eab4e6ef28148efb7a566098/.tmp/family1/de22395b31c746cb8875b37d736ad9c3 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testScannerOnBulkLoadRefHFiles/d8c03018eab4e6ef28148efb7a566098/family1/de22395b31c746cb8875b37d736ad9c3 2023-02-13 17:54:24,836 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testScannerOnBulkLoadRefHFiles/d8c03018eab4e6ef28148efb7a566098/family1/de22395b31c746cb8875b37d736ad9c3, entries=1, sequenceid=5, filesize=4.9 K 2023-02-13 17:54:24,837 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for d8c03018eab4e6ef28148efb7a566098 in 38ms, sequenceid=5, compaction requested=false 2023-02-13 17:54:24,837 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testScannerOnBulkLoadRefHFiles' 2023-02-13 17:54:24,838 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for d8c03018eab4e6ef28148efb7a566098: 2023-02-13 17:54:24,838 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1676310862672.d8c03018eab4e6ef28148efb7a566098. 2023-02-13 17:54:24,838 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 17:54:24,838 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 17:54:24,838 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:24,838 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-02-13 17:54:24,838 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-02-13 17:54:24,840 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:24,840 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:24,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:24,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:24,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:24,841 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:24,841 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:54:24,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:24,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:24,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:24,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:24,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:24,842 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-02-13 17:54:24,842 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@50921a86[Count = 0] remaining members to acquire global barrier 2023-02-13 17:54:24,842 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-02-13 17:54:24,843 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:24,844 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:24,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:24,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:24,844 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-02-13 17:54:24,845 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-02-13 17:54:24,845 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:54:24,845 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:24,845 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:54:24,847 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-02-13 17:54:24,847 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:24,847 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:24,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:24,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:24,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:24,847 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-02-13 17:54:24,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:24,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:24,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:24,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:24,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:24,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:24,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:24,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:54:24,850 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-02-13 17:54:24,850 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-02-13 17:54:24,850 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:54:24,850 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:54:24,850 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:24,850 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:54:24,852 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:24,852 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:24,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:24,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:24,852 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:24,852 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:24,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:24,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:24,853 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:24,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:24,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:24,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:24,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:24,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:24,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:24,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:24,855 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:24,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:24,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:24,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:24,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:24,861 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:24,861 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:24,861 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:24,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:24,861 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-02-13 17:54:24,861 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:54:24,861 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:24,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:24,861 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-02-13 17:54:24,861 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:24,861 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:24,861 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-02-13 17:54:24,861 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:54:24,861 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:24,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:24,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:24,862 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:24,862 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:24,862 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:24,962 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:54:24,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:54:24,967 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:54:24,989 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 17:54:24,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testScannerOnBulkLoadRefHFiles was in running list but was completed. Accepting new attempt. 2023-02-13 17:54:24,989 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x15f2ae72 to 127.0.0.1:64825 2023-02-13 17:54:24,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:24,989 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 17:54:24,989 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-02-13 17:54:24,989 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:24,989 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-02-13 17:54:24,989 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-02-13 17:54:24,990 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 17:54:24,990 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5c367b15 to 127.0.0.1:64825 2023-02-13 17:54:24,990 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 17:54:24,990 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 17:54:24,990 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x46373cc8 to 127.0.0.1:64825 2023-02-13 17:54:24,990 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 17:54:24,991 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 17:54:24,991 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7c3569a1 to 127.0.0.1:64825 2023-02-13 17:54:24,991 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 17:54:24,994 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:24,995 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:24,999 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:24,999 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:24,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:25,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:25,000 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:25,000 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:54:25,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:25,000 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:25,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:54:25,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:25,001 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:25,001 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:25,001 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-02-13 17:54:25,001 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:25,001 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-02-13 17:54:25,001 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1676310862672.ac0d738464f62c71a828e94f1b2c219e. 2023-02-13 17:54:25,001 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1676310862672.ac0d738464f62c71a828e94f1b2c219e. started... 2023-02-13 17:54:25,001 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for ac0d738464f62c71a828e94f1b2c219e: 2023-02-13 17:54:25,001 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1676310862672.ac0d738464f62c71a828e94f1b2c219e. 2023-02-13 17:54:25,003 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 17:54:25,003 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1676310862672.d8c03018eab4e6ef28148efb7a566098. 2023-02-13 17:54:25,003 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1676310862672.e21ab587bd90d22ef3de7b8eb89e7b53. 2023-02-13 17:54:25,003 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1676310862672.d8c03018eab4e6ef28148efb7a566098. started... 2023-02-13 17:54:25,003 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:54:25,003 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1676310862672.e21ab587bd90d22ef3de7b8eb89e7b53. started... 2023-02-13 17:54:25,003 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing d8c03018eab4e6ef28148efb7a566098 2/2 column families, dataSize=90 B heapSize=752 B 2023-02-13 17:54:25,004 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for e21ab587bd90d22ef3de7b8eb89e7b53: 2023-02-13 17:54:25,003 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 17:54:25,004 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1676310862672.e21ab587bd90d22ef3de7b8eb89e7b53. 2023-02-13 17:54:25,004 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 17:54:25,420 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021384ab539b5cae43238d3516e31bf286ce to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c2023021384ab539b5cae43238d3516e31bf286ce 2023-02-13 17:54:25,825 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=90, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testScannerOnBulkLoadRefHFiles/d8c03018eab4e6ef28148efb7a566098/.tmp/family1/527636e16d9b4e2aac0f42823c27b458 2023-02-13 17:54:25,830 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testScannerOnBulkLoadRefHFiles/d8c03018eab4e6ef28148efb7a566098/.tmp/family1/527636e16d9b4e2aac0f42823c27b458 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testScannerOnBulkLoadRefHFiles/d8c03018eab4e6ef28148efb7a566098/family1/527636e16d9b4e2aac0f42823c27b458 2023-02-13 17:54:25,834 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testScannerOnBulkLoadRefHFiles/d8c03018eab4e6ef28148efb7a566098/family1/527636e16d9b4e2aac0f42823c27b458, entries=2, sequenceid=9, filesize=5.0 K 2023-02-13 17:54:25,835 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~90 B/90, heapSize ~480 B/480, currentSize=0 B/0 for d8c03018eab4e6ef28148efb7a566098 in 832ms, sequenceid=9, compaction requested=false 2023-02-13 17:54:25,835 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for d8c03018eab4e6ef28148efb7a566098: 2023-02-13 17:54:25,835 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1676310862672.d8c03018eab4e6ef28148efb7a566098. 2023-02-13 17:54:25,835 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 17:54:25,835 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 17:54:25,835 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:25,835 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-02-13 17:54:25,835 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-02-13 17:54:25,837 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:25,837 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:25,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:25,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:25,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:25,837 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:25,837 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:54:25,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:25,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:25,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:25,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:25,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:25,839 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-02-13 17:54:25,839 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2442b9da[Count = 0] remaining members to acquire global barrier 2023-02-13 17:54:25,839 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-02-13 17:54:25,839 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:25,840 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:25,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:25,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:25,840 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:25,840 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-02-13 17:54:25,840 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-02-13 17:54:25,840 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:54:25,840 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:54:25,842 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:25,842 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-02-13 17:54:25,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:25,843 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:25,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:25,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:25,843 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-02-13 17:54:25,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:25,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:25,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:25,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:25,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:25,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:25,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:25,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:54:25,845 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-02-13 17:54:25,845 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-02-13 17:54:25,845 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:54:25,845 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:54:25,845 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:25,845 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:54:25,847 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:25,847 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:25,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:25,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:25,847 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:25,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:25,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:25,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:25,847 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:25,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:25,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:25,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:25,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:25,848 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:25,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:25,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:25,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:25,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:25,850 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:25,850 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:25,850 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-02-13 17:54:25,850 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:25,850 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-02-13 17:54:25,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:25,850 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-02-13 17:54:25,851 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:54:25,850 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:25,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:25,851 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:25,851 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:25,851 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:25,851 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:25,851 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:25,851 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-02-13 17:54:25,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:25,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:25,851 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:54:25,951 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:54:25,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:54:25,961 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41433] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testScannerOnBulkLoadRefHFiles 2023-02-13 17:54:25,963 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-02-13 17:54:25,964 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-02-13 17:54:25,965 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] mob.MobUtils(833): start MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 17:54:25,965 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676311465965 2023-02-13 17:54:25,966 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-13 17:54:25,966 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testScannerOnBulkLoadRefHFiles' and column 'family1' 2023-02-13 17:54:25,966 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-02-13 17:54:25,966 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] zookeeper.ReadOnlyZKClient(139): Connect 0x0f172e0d to 127.0.0.1:64825 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 17:54:25,971 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@250f86b5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 17:54:25,972 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230213 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-02-13 17:54:26,806 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213ecf82bad20234988be2f2ff200005c61 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230213ecf82bad20234988be2f2ff200005c61 2023-02-13 17:54:26,808 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230213 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-02-13 17:54:26,825 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 17:54:26,827 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60280, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 17:54:26,837 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 17:54:26,840 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54650, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 17:54:26,856 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230213/family1/b247d051bb3a45a98ff5cac2d22bb82a first=Optional[k0] last=Optional[k1] 2023-02-13 17:54:26,864 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testScannerOnBulkLoadRefHFiles,2,1676310862672.d8c03018eab4e6ef28148efb7a566098., hostname=jenkins-hbase4.apache.org,38881,1676310818035, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230213/family1/b247d051bb3a45a98ff5cac2d22bb82a}] 2023-02-13 17:54:26,879 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(763): Validating hfile at hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230213/family1/b247d051bb3a45a98ff5cac2d22bb82a for inclusion in d8c03018eab4e6ef28148efb7a566098/family1 2023-02-13 17:54:26,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(775): HFile bounds: first=k0 last=k1 2023-02-13 17:54:26,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-13 17:54:26,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegion(2445): Flush status journal for d8c03018eab4e6ef28148efb7a566098: 2023-02-13 17:54:26,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230213/family1/b247d051bb3a45a98ff5cac2d22bb82a to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testScannerOnBulkLoadRefHFiles__uno9jcajd2ppcascqa2ii0pl3gqu7dl85uarq72r1ah88tgfr3mh933ujbc0vr3n/family1/b247d051bb3a45a98ff5cac2d22bb82a 2023-02-13 17:54:26,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testScannerOnBulkLoadRefHFiles__uno9jcajd2ppcascqa2ii0pl3gqu7dl85uarq72r1ah88tgfr3mh933ujbc0vr3n/family1/b247d051bb3a45a98ff5cac2d22bb82a as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testScannerOnBulkLoadRefHFiles/d8c03018eab4e6ef28148efb7a566098/family1/2e7e005614b14ae4b7ed928d6ac7acf6_SeqId_12_ 2023-02-13 17:54:26,892 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(849): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testScannerOnBulkLoadRefHFiles__uno9jcajd2ppcascqa2ii0pl3gqu7dl85uarq72r1ah88tgfr3mh933ujbc0vr3n/family1/b247d051bb3a45a98ff5cac2d22bb82a into d8c03018eab4e6ef28148efb7a566098/family1 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testScannerOnBulkLoadRefHFiles/d8c03018eab4e6ef28148efb7a566098/family1/2e7e005614b14ae4b7ed928d6ac7acf6_SeqId_12_ - updating store file list. 2023-02-13 17:54:26,901 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(882): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testScannerOnBulkLoadRefHFiles/d8c03018eab4e6ef28148efb7a566098/family1/2e7e005614b14ae4b7ed928d6ac7acf6_SeqId_12_ into d8c03018eab4e6ef28148efb7a566098/family1 2023-02-13 17:54:26,901 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(855): Successfully loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testScannerOnBulkLoadRefHFiles__uno9jcajd2ppcascqa2ii0pl3gqu7dl85uarq72r1ah88tgfr3mh933ujbc0vr3n/family1/b247d051bb3a45a98ff5cac2d22bb82a into d8c03018eab4e6ef28148efb7a566098/family1 (new location: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testScannerOnBulkLoadRefHFiles/d8c03018eab4e6ef28148efb7a566098/family1/2e7e005614b14ae4b7ed928d6ac7acf6_SeqId_12_) 2023-02-13 17:54:26,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testScannerOnBulkLoadRefHFiles__uno9jcajd2ppcascqa2ii0pl3gqu7dl85uarq72r1ah88tgfr3mh933ujbc0vr3n/family1/b247d051bb3a45a98ff5cac2d22bb82a 2023-02-13 17:54:26,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-13 17:54:26,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 15445 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-13 17:54:26,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(1912): d8c03018eab4e6ef28148efb7a566098/family1 is initiating minor compaction (all files) 2023-02-13 17:54:26,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@759c7103; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 17:54:26,903 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of d8c03018eab4e6ef28148efb7a566098/family1 in testScannerOnBulkLoadRefHFiles,2,1676310862672.d8c03018eab4e6ef28148efb7a566098. 2023-02-13 17:54:26,904 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testScannerOnBulkLoadRefHFiles/d8c03018eab4e6ef28148efb7a566098/family1/de22395b31c746cb8875b37d736ad9c3, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testScannerOnBulkLoadRefHFiles/d8c03018eab4e6ef28148efb7a566098/family1/527636e16d9b4e2aac0f42823c27b458, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testScannerOnBulkLoadRefHFiles/d8c03018eab4e6ef28148efb7a566098/family1/2e7e005614b14ae4b7ed928d6ac7acf6_SeqId_12_] into tmpdir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testScannerOnBulkLoadRefHFiles/d8c03018eab4e6ef28148efb7a566098/.tmp, totalSize=15.1 K 2023-02-13 17:54:26,904 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting de22395b31c746cb8875b37d736ad9c3, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676310864783 2023-02-13 17:54:26,905 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting 527636e16d9b4e2aac0f42823c27b458, keycount=2, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676310864783 2023-02-13 17:54:26,905 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting 2e7e005614b14ae4b7ed928d6ac7acf6_SeqId_12_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676310864783 2023-02-13 17:54:26,918 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230213 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-02-13 17:54:26,919 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:54:26,921 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c2023021384ab539b5cae43238d3516e31bf286ce to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c2023021384ab539b5cae43238d3516e31bf286ce 2023-02-13 17:54:26,924 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230213bfe32e41162f4f02b4d24130319b0bf6 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230213bfe32e41162f4f02b4d24130319b0bf6 2023-02-13 17:54:26,924 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testScannerOnBulkLoadRefHFiles 2 expired mob files are deleted 2023-02-13 17:54:26,924 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230213' 2023-02-13 17:54:26,926 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230213 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-02-13 17:54:26,926 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-02-13 17:54:26,926 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] mob.MobUtils(840): end MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 17:54:26,933 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-02-13 17:54:26,936 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE in 971 msec 2023-02-13 17:54:26,958 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] throttle.PressureAwareThroughputController(145): d8c03018eab4e6ef28148efb7a566098#family1#compaction#38 average throughput is 0.01 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 17:54:26,989 WARN [DataStreamer for file /user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021367c302a59bbd47f0a94d05036657efdf_del block BP-1376670031-172.31.14.131-1676310813462:blk_1073741944_1120] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.closeInternal(DataStreamer.java:844) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:840) 2023-02-13 17:54:26,991 INFO [Listener at localhost/35343] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=249 (was 261), OpenFileDescriptor=596 (was 623), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=283 (was 264) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=1306 (was 1479) 2023-02-13 17:54:27,008 INFO [Listener at localhost/35343] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=249, OpenFileDescriptor=598, MaxFileDescriptor=60000, SystemLoadAverage=283, ProcessCount=168, AvailableMemoryMB=1305 2023-02-13 17:54:27,011 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-13 17:54:27,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:27,018 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 17:54:27,019 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyPolicy" procId is: 35 2023-02-13 17:54:27,019 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 17:54:27,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-13 17:54:27,028 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1 2023-02-13 17:54:27,034 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1 empty. 2023-02-13 17:54:27,035 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1 2023-02-13 17:54:27,035 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyPolicy regions 2023-02-13 17:54:27,051 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testScannerOnBulkLoadRefHFiles/d8c03018eab4e6ef28148efb7a566098/.tmp/family1/589621cd648340c195f1169b06cf9e66 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testScannerOnBulkLoadRefHFiles/d8c03018eab4e6ef28148efb7a566098/family1/589621cd648340c195f1169b06cf9e66 2023-02-13 17:54:27,054 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-02-13 17:54:27,060 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7671): creating {ENCODED => f19921593afbd7b00a7e7155a8bb7bf1, NAME => 'testMajorCompactionWithWeeklyPolicy,,1676310867011.f19921593afbd7b00a7e7155a8bb7bf1.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp 2023-02-13 17:54:27,061 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in d8c03018eab4e6ef28148efb7a566098/family1 of d8c03018eab4e6ef28148efb7a566098 into 589621cd648340c195f1169b06cf9e66(size=5.1 K), total size for store is 5.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 17:54:27,061 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for d8c03018eab4e6ef28148efb7a566098: 2023-02-13 17:54:27,061 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testScannerOnBulkLoadRefHFiles,2,1676310862672.d8c03018eab4e6ef28148efb7a566098., storeName=family1, fileCount=3, fileSize=15.1 K (4.9 K, 5.0 K, 5.2 K), priority=2, time=1676310866903; duration=0sec 2023-02-13 17:54:27,061 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 17:54:27,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-13 17:54:27,169 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testScannerOnBulkLoadRefHFiles/d8c03018eab4e6ef28148efb7a566098/family1/de22395b31c746cb8875b37d736ad9c3, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testScannerOnBulkLoadRefHFiles/d8c03018eab4e6ef28148efb7a566098/family1/527636e16d9b4e2aac0f42823c27b458, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testScannerOnBulkLoadRefHFiles/d8c03018eab4e6ef28148efb7a566098/family1/2e7e005614b14ae4b7ed928d6ac7acf6_SeqId_12_] to archive 2023-02-13 17:54:27,170 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:54:27,173 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testScannerOnBulkLoadRefHFiles/d8c03018eab4e6ef28148efb7a566098/family1/de22395b31c746cb8875b37d736ad9c3 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testScannerOnBulkLoadRefHFiles/d8c03018eab4e6ef28148efb7a566098/family1/de22395b31c746cb8875b37d736ad9c3 2023-02-13 17:54:27,180 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testScannerOnBulkLoadRefHFiles/d8c03018eab4e6ef28148efb7a566098/family1/527636e16d9b4e2aac0f42823c27b458 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testScannerOnBulkLoadRefHFiles/d8c03018eab4e6ef28148efb7a566098/family1/527636e16d9b4e2aac0f42823c27b458 2023-02-13 17:54:27,183 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testScannerOnBulkLoadRefHFiles/d8c03018eab4e6ef28148efb7a566098/family1/2e7e005614b14ae4b7ed928d6ac7acf6_SeqId_12_ to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testScannerOnBulkLoadRefHFiles/d8c03018eab4e6ef28148efb7a566098/family1/2e7e005614b14ae4b7ed928d6ac7acf6_SeqId_12_ 2023-02-13 17:54:27,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-13 17:54:27,487 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyPolicy,,1676310867011.f19921593afbd7b00a7e7155a8bb7bf1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 17:54:27,487 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1603): Closing f19921593afbd7b00a7e7155a8bb7bf1, disabling compactions & flushes 2023-02-13 17:54:27,487 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyPolicy,,1676310867011.f19921593afbd7b00a7e7155a8bb7bf1. 2023-02-13 17:54:27,487 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1676310867011.f19921593afbd7b00a7e7155a8bb7bf1. 2023-02-13 17:54:27,487 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1676310867011.f19921593afbd7b00a7e7155a8bb7bf1. after waiting 0 ms 2023-02-13 17:54:27,487 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1676310867011.f19921593afbd7b00a7e7155a8bb7bf1. 2023-02-13 17:54:27,487 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyPolicy,,1676310867011.f19921593afbd7b00a7e7155a8bb7bf1. 2023-02-13 17:54:27,487 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1557): Region close journal for f19921593afbd7b00a7e7155a8bb7bf1: Waiting for close lock at 1676310867487Disabling compacts and flushes for region at 1676310867487Disabling writes for close at 1676310867487Writing region close event to WAL at 1676310867487Closed at 1676310867487 2023-02-13 17:54:27,490 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 17:54:27,492 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyPolicy,,1676310867011.f19921593afbd7b00a7e7155a8bb7bf1.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676310867492"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676310867492"}]},"ts":"1676310867492"} 2023-02-13 17:54:27,502 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 17:54:27,503 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 17:54:27,503 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676310867503"}]},"ts":"1676310867503"} 2023-02-13 17:54:27,505 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-02-13 17:54:27,510 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=f19921593afbd7b00a7e7155a8bb7bf1, ASSIGN}] 2023-02-13 17:54:27,512 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=f19921593afbd7b00a7e7155a8bb7bf1, ASSIGN 2023-02-13 17:54:27,513 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=f19921593afbd7b00a7e7155a8bb7bf1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38881,1676310818035; forceNewPlan=false, retain=false 2023-02-13 17:54:27,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-13 17:54:27,664 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=f19921593afbd7b00a7e7155a8bb7bf1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:27,664 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyPolicy,,1676310867011.f19921593afbd7b00a7e7155a8bb7bf1.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676310867664"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676310867664"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676310867664"}]},"ts":"1676310867664"} 2023-02-13 17:54:27,666 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; OpenRegionProcedure f19921593afbd7b00a7e7155a8bb7bf1, server=jenkins-hbase4.apache.org,38881,1676310818035}] 2023-02-13 17:54:27,821 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyPolicy,,1676310867011.f19921593afbd7b00a7e7155a8bb7bf1. 2023-02-13 17:54:27,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f19921593afbd7b00a7e7155a8bb7bf1, NAME => 'testMajorCompactionWithWeeklyPolicy,,1676310867011.f19921593afbd7b00a7e7155a8bb7bf1.', STARTKEY => '', ENDKEY => ''} 2023-02-13 17:54:27,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyPolicy f19921593afbd7b00a7e7155a8bb7bf1 2023-02-13 17:54:27,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyPolicy,,1676310867011.f19921593afbd7b00a7e7155a8bb7bf1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 17:54:27,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for f19921593afbd7b00a7e7155a8bb7bf1 2023-02-13 17:54:27,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for f19921593afbd7b00a7e7155a8bb7bf1 2023-02-13 17:54:27,823 INFO [StoreOpener-f19921593afbd7b00a7e7155a8bb7bf1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f19921593afbd7b00a7e7155a8bb7bf1 2023-02-13 17:54:27,825 DEBUG [StoreOpener-f19921593afbd7b00a7e7155a8bb7bf1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1 2023-02-13 17:54:27,825 DEBUG [StoreOpener-f19921593afbd7b00a7e7155a8bb7bf1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1 2023-02-13 17:54:27,826 INFO [StoreOpener-f19921593afbd7b00a7e7155a8bb7bf1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f19921593afbd7b00a7e7155a8bb7bf1 columnFamilyName family1 2023-02-13 17:54:27,827 INFO [StoreOpener-f19921593afbd7b00a7e7155a8bb7bf1-1] regionserver.HStore(310): Store=f19921593afbd7b00a7e7155a8bb7bf1/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 17:54:27,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1 2023-02-13 17:54:27,829 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1 2023-02-13 17:54:27,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for f19921593afbd7b00a7e7155a8bb7bf1 2023-02-13 17:54:27,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 17:54:27,839 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened f19921593afbd7b00a7e7155a8bb7bf1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71009676, jitterRate=0.058126628398895264}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 17:54:27,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for f19921593afbd7b00a7e7155a8bb7bf1: Running coprocessor pre-open hook at 1676310867822Writing region info on filesystem at 1676310867822Initializing all the Stores at 1676310867823 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1676310867823Cleaning up temporary data from old regions at 1676310867833 (+10 ms)Cleaning up detritus from prior splits at 1676310867833Running coprocessor post-open hooks at 1676310867839 (+6 ms)Region opened successfully at 1676310867839 2023-02-13 17:54:27,840 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyPolicy,,1676310867011.f19921593afbd7b00a7e7155a8bb7bf1., pid=37, masterSystemTime=1676310867818 2023-02-13 17:54:27,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyPolicy,,1676310867011.f19921593afbd7b00a7e7155a8bb7bf1. 2023-02-13 17:54:27,842 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyPolicy,,1676310867011.f19921593afbd7b00a7e7155a8bb7bf1. 2023-02-13 17:54:27,842 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=f19921593afbd7b00a7e7155a8bb7bf1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:27,842 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyPolicy,,1676310867011.f19921593afbd7b00a7e7155a8bb7bf1.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676310867842"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676310867842"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676310867842"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676310867842"}]},"ts":"1676310867842"} 2023-02-13 17:54:27,845 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-02-13 17:54:27,845 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; OpenRegionProcedure f19921593afbd7b00a7e7155a8bb7bf1, server=jenkins-hbase4.apache.org,38881,1676310818035 in 177 msec 2023-02-13 17:54:27,847 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=36, resume processing ppid=35 2023-02-13 17:54:27,847 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=f19921593afbd7b00a7e7155a8bb7bf1, ASSIGN in 335 msec 2023-02-13 17:54:27,848 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 17:54:27,848 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676310867848"}]},"ts":"1676310867848"} 2023-02-13 17:54:27,849 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-02-13 17:54:27,851 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 17:54:27,853 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy in 839 msec 2023-02-13 17:54:27,951 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 17:54:28,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-13 17:54:28,125 INFO [Listener at localhost/35343] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyPolicy, procId: 35 completed 2023-02-13 17:54:28,150 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:54:28,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:28,154 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 17:54:28,154 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:28,154 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 17:54:28,154 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 17:54:28,155 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:28,155 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:28,156 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:28,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:28,156 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:28,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:28,157 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:28,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:28,157 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:54:28,157 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:28,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:54:28,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:28,157 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:28,158 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:28,158 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 17:54:28,158 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:28,158 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 17:54:28,160 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:54:28,160 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:54:28,160 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676310867011.f19921593afbd7b00a7e7155a8bb7bf1. 2023-02-13 17:54:28,160 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676310867011.f19921593afbd7b00a7e7155a8bb7bf1. started... 2023-02-13 17:54:28,161 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f19921593afbd7b00a7e7155a8bb7bf1 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-13 17:54:28,184 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130bf2fce86375343a1b870b30fb15c058d to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130bf2fce86375343a1b870b30fb15c058d 2023-02-13 17:54:28,588 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/.tmp/family1/4492cc69f63445f5b7cad5aa31c68cdb 2023-02-13 17:54:28,593 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/.tmp/family1/4492cc69f63445f5b7cad5aa31c68cdb as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/4492cc69f63445f5b7cad5aa31c68cdb 2023-02-13 17:54:28,597 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/4492cc69f63445f5b7cad5aa31c68cdb, entries=1000, sequenceid=5, filesize=165.1 K 2023-02-13 17:54:28,598 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for f19921593afbd7b00a7e7155a8bb7bf1 in 437ms, sequenceid=5, compaction requested=false 2023-02-13 17:54:28,599 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f19921593afbd7b00a7e7155a8bb7bf1: 2023-02-13 17:54:28,599 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676310867011.f19921593afbd7b00a7e7155a8bb7bf1. 2023-02-13 17:54:28,599 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:54:28,599 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:54:28,599 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:28,599 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 17:54:28,599 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-13 17:54:28,600 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:28,600 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:28,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:28,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:28,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:28,601 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:28,601 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:54:28,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:28,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:28,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:28,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:28,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:28,602 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 17:54:28,602 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4684594e[Count = 0] remaining members to acquire global barrier 2023-02-13 17:54:28,602 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 17:54:28,602 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:28,603 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:28,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:28,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:28,603 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 17:54:28,603 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-13 17:54:28,603 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:54:28,603 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:28,603 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:54:28,605 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 17:54:28,605 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:28,605 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:28,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:28,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:28,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:28,606 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-13 17:54:28,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:28,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:28,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:28,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:28,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:28,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:28,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:28,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:54:28,607 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 17:54:28,607 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-13 17:54:28,608 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:54:28,608 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:54:28,608 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:28,608 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:54:28,609 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:28,609 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:28,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:28,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:28,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:28,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:28,609 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:28,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:28,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:28,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:28,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:28,610 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:28,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:28,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:28,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:28,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:28,611 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:28,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:28,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:28,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:28,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:28,613 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:28,613 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:28,613 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:28,613 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 17:54:28,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:28,613 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:28,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:28,613 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:54:28,613 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:28,613 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:28,613 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:28,613 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:28,613 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:28,613 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:28,613 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 17:54:28,613 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:54:28,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:28,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:28,714 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:54:28,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:54:28,719 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:54:28,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 17:54:28,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:28,720 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 17:54:28,720 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:28,720 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 17:54:28,720 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 17:54:28,721 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:28,721 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:28,723 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:28,723 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:28,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:28,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:28,723 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:28,723 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:54:28,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:28,723 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:28,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:54:28,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:28,724 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:28,724 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 17:54:28,724 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:28,724 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 17:54:28,724 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:28,724 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 17:54:28,724 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:54:28,724 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:54:28,724 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676310867011.f19921593afbd7b00a7e7155a8bb7bf1. 2023-02-13 17:54:28,724 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676310867011.f19921593afbd7b00a7e7155a8bb7bf1. started... 2023-02-13 17:54:28,725 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f19921593afbd7b00a7e7155a8bb7bf1 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-13 17:54:29,137 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128f84a8fe275f448f79518319ed384542f to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151128f84a8fe275f448f79518319ed384542f 2023-02-13 17:54:29,370 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 17:54:29,543 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/.tmp/family1/4790d383f1f7406d9ae974015b1059ba 2023-02-13 17:54:29,548 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/.tmp/family1/4790d383f1f7406d9ae974015b1059ba as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/4790d383f1f7406d9ae974015b1059ba 2023-02-13 17:54:29,552 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/4790d383f1f7406d9ae974015b1059ba, entries=1, sequenceid=9, filesize=5.0 K 2023-02-13 17:54:29,553 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for f19921593afbd7b00a7e7155a8bb7bf1 in 828ms, sequenceid=9, compaction requested=false 2023-02-13 17:54:29,553 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f19921593afbd7b00a7e7155a8bb7bf1: 2023-02-13 17:54:29,553 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676310867011.f19921593afbd7b00a7e7155a8bb7bf1. 2023-02-13 17:54:29,553 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:54:29,553 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:54:29,553 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:29,553 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 17:54:29,553 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-13 17:54:29,554 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:29,554 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:29,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:29,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:29,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:29,555 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:29,555 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:54:29,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:29,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:29,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:29,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:29,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:29,556 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 17:54:29,556 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@44396e5[Count = 0] remaining members to acquire global barrier 2023-02-13 17:54:29,556 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 17:54:29,556 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:29,560 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:29,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:29,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:29,560 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 17:54:29,560 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-13 17:54:29,560 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:54:29,560 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:29,561 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:54:29,563 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 17:54:29,563 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:29,563 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:29,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:29,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:29,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:29,563 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-13 17:54:29,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:29,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:29,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:29,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:29,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:29,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:29,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:29,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:54:29,565 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 17:54:29,565 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-13 17:54:29,565 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:54:29,565 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:54:29,565 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:29,565 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:54:29,566 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:29,566 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:29,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:29,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:29,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:29,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:29,566 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:29,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:29,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:29,567 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:29,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:29,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:29,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:29,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:29,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:29,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:29,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:29,568 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:29,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:29,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:29,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:29,570 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:29,570 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:29,570 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:29,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:29,570 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:29,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:29,570 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:29,570 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 17:54:29,570 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:54:29,570 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:29,570 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:29,570 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:29,570 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:29,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:29,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:29,570 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 17:54:29,570 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:29,571 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:54:29,671 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:54:29,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:54:29,676 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:54:29,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 17:54:29,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:29,678 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 17:54:29,678 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:29,678 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 17:54:29,678 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 17:54:29,678 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:29,678 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:29,680 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:29,680 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:29,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:29,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:29,680 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:29,680 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:54:29,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:29,680 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:29,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:54:29,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:29,681 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:29,681 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 17:54:29,681 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:29,681 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 17:54:29,681 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:29,681 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 17:54:29,681 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:54:29,681 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:54:29,681 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676310867011.f19921593afbd7b00a7e7155a8bb7bf1. 2023-02-13 17:54:29,681 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676310867011.f19921593afbd7b00a7e7155a8bb7bf1. started... 2023-02-13 17:54:29,681 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f19921593afbd7b00a7e7155a8bb7bf1 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 17:54:30,095 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120127f90f7363dd41c5a4f75bf9990c0e1b to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015120127f90f7363dd41c5a4f75bf9990c0e1b 2023-02-13 17:54:30,104 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/.tmp/family1/2b8d478d97b74e57a0173b33b2014f06 2023-02-13 17:54:30,109 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/.tmp/family1/2b8d478d97b74e57a0173b33b2014f06 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/2b8d478d97b74e57a0173b33b2014f06 2023-02-13 17:54:30,112 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/2b8d478d97b74e57a0173b33b2014f06, entries=1, sequenceid=13, filesize=4.9 K 2023-02-13 17:54:30,113 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f19921593afbd7b00a7e7155a8bb7bf1 in 432ms, sequenceid=13, compaction requested=true 2023-02-13 17:54:30,113 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f19921593afbd7b00a7e7155a8bb7bf1: 2023-02-13 17:54:30,113 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676310867011.f19921593afbd7b00a7e7155a8bb7bf1. 2023-02-13 17:54:30,113 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:54:30,113 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:54:30,113 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:30,114 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 17:54:30,114 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-13 17:54:30,116 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:30,116 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:30,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:30,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:30,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:30,116 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:30,116 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:54:30,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:30,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:30,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:30,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:30,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:30,117 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 17:54:30,117 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@44c5eac1[Count = 0] remaining members to acquire global barrier 2023-02-13 17:54:30,117 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 17:54:30,117 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:30,118 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:30,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:30,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:30,119 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 17:54:30,119 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-13 17:54:30,119 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:54:30,119 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:30,119 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:54:30,120 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 17:54:30,120 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:30,120 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:30,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:30,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:30,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:30,120 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-13 17:54:30,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:30,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:30,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:30,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:30,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:30,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:30,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:30,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:54:30,122 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 17:54:30,122 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-13 17:54:30,122 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:54:30,122 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:54:30,122 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:30,122 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:54:30,124 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:30,124 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:30,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:30,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:30,124 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:30,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:30,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:30,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:30,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:30,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:30,124 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:30,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:30,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:30,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:30,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:30,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:30,125 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:30,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:30,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:30,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:30,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:30,128 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:30,128 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:30,128 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:30,128 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:30,128 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:30,128 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:30,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:30,128 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 17:54:30,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:30,128 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 17:54:30,128 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:54:30,128 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:30,129 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:30,129 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:30,129 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:30,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:30,129 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 17:54:30,129 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:54:30,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:30,229 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:54:30,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:54:30,234 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:54:30,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 17:54:30,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:30,235 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 17:54:30,235 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:30,235 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 17:54:30,235 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 17:54:30,236 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:30,236 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:30,238 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:30,238 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:30,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:30,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:30,238 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:30,238 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:54:30,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:30,238 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:30,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:54:30,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:30,239 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:30,239 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 17:54:30,239 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:30,239 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 17:54:30,239 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:30,239 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 17:54:30,239 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:54:30,239 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:54:30,239 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676310867011.f19921593afbd7b00a7e7155a8bb7bf1. 2023-02-13 17:54:30,239 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676310867011.f19921593afbd7b00a7e7155a8bb7bf1. started... 2023-02-13 17:54:30,239 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f19921593afbd7b00a7e7155a8bb7bf1 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 17:54:30,652 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120518658e9ca70d4f139121cb754500a731 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015120518658e9ca70d4f139121cb754500a731 2023-02-13 17:54:31,058 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/.tmp/family1/a4e4e7fda9874f17a9addeeea328b0b6 2023-02-13 17:54:31,063 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/.tmp/family1/a4e4e7fda9874f17a9addeeea328b0b6 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/a4e4e7fda9874f17a9addeeea328b0b6 2023-02-13 17:54:31,067 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/a4e4e7fda9874f17a9addeeea328b0b6, entries=1, sequenceid=17, filesize=4.9 K 2023-02-13 17:54:31,068 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f19921593afbd7b00a7e7155a8bb7bf1 in 829ms, sequenceid=17, compaction requested=true 2023-02-13 17:54:31,068 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f19921593afbd7b00a7e7155a8bb7bf1: 2023-02-13 17:54:31,068 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676310867011.f19921593afbd7b00a7e7155a8bb7bf1. 2023-02-13 17:54:31,068 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:54:31,068 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:54:31,068 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:31,068 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 17:54:31,068 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-13 17:54:31,070 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:31,070 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:31,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:31,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:31,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:31,070 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:31,070 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:54:31,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:31,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:31,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:31,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:31,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:31,072 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 17:54:31,072 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@757807ea[Count = 0] remaining members to acquire global barrier 2023-02-13 17:54:31,072 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 17:54:31,072 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:31,073 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:31,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:31,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:31,073 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 17:54:31,073 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-13 17:54:31,073 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:31,073 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:54:31,073 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:54:31,078 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 17:54:31,078 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:31,078 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:31,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:31,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:31,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:31,078 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-13 17:54:31,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:31,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:31,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:31,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:31,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:31,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:31,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:31,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:54:31,081 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 17:54:31,081 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-13 17:54:31,081 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:54:31,081 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:54:31,081 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:31,081 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:54:31,083 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:31,083 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:31,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:31,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:31,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:31,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:31,083 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:31,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:31,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:31,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:31,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:31,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:31,084 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:31,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:31,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:31,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:31,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:31,085 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:31,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:31,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:31,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:31,087 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:31,087 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:31,087 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:31,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:31,087 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 17:54:31,087 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:54:31,087 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:31,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:31,087 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:31,087 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:31,088 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:31,088 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:31,088 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 17:54:31,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:31,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:31,088 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:31,088 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:54:31,088 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:31,188 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:54:31,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:54:31,193 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:54:31,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 17:54:31,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:31,194 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 17:54:31,194 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:31,194 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 17:54:31,194 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 17:54:31,195 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:31,195 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:31,197 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:31,197 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:31,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:31,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:31,197 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:31,197 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:54:31,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:31,197 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:31,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:54:31,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:31,198 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:31,198 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 17:54:31,198 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:31,198 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 17:54:31,198 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:31,198 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 17:54:31,198 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:54:31,198 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:54:31,198 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676310867011.f19921593afbd7b00a7e7155a8bb7bf1. 2023-02-13 17:54:31,198 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676310867011.f19921593afbd7b00a7e7155a8bb7bf1. started... 2023-02-13 17:54:31,198 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f19921593afbd7b00a7e7155a8bb7bf1 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 17:54:31,611 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122823337c12968f4a5ea6cf9cdd9519da9d to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015122823337c12968f4a5ea6cf9cdd9519da9d 2023-02-13 17:54:32,016 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/.tmp/family1/84afb6046ac34f9888be2e5a35b9b654 2023-02-13 17:54:32,021 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/.tmp/family1/84afb6046ac34f9888be2e5a35b9b654 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/84afb6046ac34f9888be2e5a35b9b654 2023-02-13 17:54:32,025 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/84afb6046ac34f9888be2e5a35b9b654, entries=1, sequenceid=21, filesize=4.9 K 2023-02-13 17:54:32,026 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f19921593afbd7b00a7e7155a8bb7bf1 in 828ms, sequenceid=21, compaction requested=true 2023-02-13 17:54:32,026 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f19921593afbd7b00a7e7155a8bb7bf1: 2023-02-13 17:54:32,026 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676310867011.f19921593afbd7b00a7e7155a8bb7bf1. 2023-02-13 17:54:32,026 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:54:32,026 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:54:32,026 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:32,026 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 17:54:32,026 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-13 17:54:32,031 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:32,031 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:32,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:32,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:32,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:32,031 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:32,031 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:54:32,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:32,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:32,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:32,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:32,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:32,033 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 17:54:32,033 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 17:54:32,033 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@11d26e22[Count = 0] remaining members to acquire global barrier 2023-02-13 17:54:32,033 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:32,034 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:32,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:32,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:32,034 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 17:54:32,034 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-13 17:54:32,034 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:32,034 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:54:32,034 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:54:32,036 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 17:54:32,036 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:32,036 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:32,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:32,036 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-13 17:54:32,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:32,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:32,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:32,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:32,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:32,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:32,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:32,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:32,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:32,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:54:32,038 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 17:54:32,038 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-13 17:54:32,038 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:54:32,038 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:54:32,038 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:32,038 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:54:32,039 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:32,039 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:32,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:32,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:32,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:32,039 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:32,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:32,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:32,040 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:32,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:32,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:32,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:32,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:32,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:32,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:32,041 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:32,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:32,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:32,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:32,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:32,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:32,043 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:32,043 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:32,043 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:32,043 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:32,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:32,043 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:32,043 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:32,043 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 17:54:32,044 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:54:32,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:32,043 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:32,044 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:32,044 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:32,044 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:32,044 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 17:54:32,044 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 17:54:32,044 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:54:32,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:32,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:32,144 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:54:32,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:54:32,149 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:54:32,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 17:54:32,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:32,150 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 17:54:32,150 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:32,150 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 17:54:32,150 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 17:54:32,151 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:32,151 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:32,152 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:32,152 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:32,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:32,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:32,152 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:32,152 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:54:32,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:32,153 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:32,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:54:32,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:32,153 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:32,153 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 17:54:32,153 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:32,153 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 17:54:32,153 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:32,153 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 17:54:32,154 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:54:32,154 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:54:32,154 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676310867011.f19921593afbd7b00a7e7155a8bb7bf1. 2023-02-13 17:54:32,154 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676310867011.f19921593afbd7b00a7e7155a8bb7bf1. started... 2023-02-13 17:54:32,154 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f19921593afbd7b00a7e7155a8bb7bf1 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 17:54:32,565 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512319c729c0da3dd4b05b10999357d5e0ec0 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512319c729c0da3dd4b05b10999357d5e0ec0 2023-02-13 17:54:32,971 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/.tmp/family1/824fd9db7f284cceb4d0cbf45fb66110 2023-02-13 17:54:32,976 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/.tmp/family1/824fd9db7f284cceb4d0cbf45fb66110 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/824fd9db7f284cceb4d0cbf45fb66110 2023-02-13 17:54:32,980 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/824fd9db7f284cceb4d0cbf45fb66110, entries=1, sequenceid=25, filesize=4.9 K 2023-02-13 17:54:32,981 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f19921593afbd7b00a7e7155a8bb7bf1 in 827ms, sequenceid=25, compaction requested=true 2023-02-13 17:54:32,981 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f19921593afbd7b00a7e7155a8bb7bf1: 2023-02-13 17:54:32,981 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676310867011.f19921593afbd7b00a7e7155a8bb7bf1. 2023-02-13 17:54:32,981 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:54:32,981 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:54:32,981 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:32,981 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 17:54:32,981 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-13 17:54:32,982 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:32,982 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:32,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:32,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:32,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:32,983 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:32,983 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:54:32,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:32,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:32,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:32,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:32,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:32,984 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 17:54:32,984 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9be3643[Count = 0] remaining members to acquire global barrier 2023-02-13 17:54:32,984 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 17:54:32,984 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:32,985 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:32,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:32,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:32,985 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 17:54:32,985 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-13 17:54:32,985 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:54:32,985 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:32,986 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:54:32,987 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 17:54:32,987 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:32,987 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:32,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:32,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:32,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:32,988 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-13 17:54:32,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:32,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:32,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:32,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:32,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:32,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:32,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:32,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:54:32,990 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 17:54:32,990 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-13 17:54:32,990 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:54:32,990 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:54:32,990 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:32,990 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:54:32,991 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:32,991 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:32,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:32,991 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:32,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:32,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:32,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:32,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:32,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:32,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:32,992 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:32,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:32,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:32,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:32,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:32,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:32,993 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:32,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:32,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:32,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:32,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:32,995 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:32,995 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:32,995 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:32,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:32,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:32,995 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:32,995 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 17:54:32,995 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:54:32,995 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:32,995 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:32,995 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 17:54:32,995 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:32,995 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:32,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:32,995 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 17:54:32,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:32,995 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:32,995 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:54:32,995 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:33,096 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:54:33,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:54:33,101 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:54:33,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 17:54:33,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:33,102 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 17:54:33,102 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:33,102 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 17:54:33,102 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 17:54:33,103 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:33,103 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:33,104 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:33,104 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:33,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:33,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:33,104 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:33,104 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:54:33,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:33,105 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:33,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:54:33,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:33,105 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:33,106 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 17:54:33,106 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:33,106 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 17:54:33,106 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:33,106 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 17:54:33,106 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:54:33,106 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:54:33,106 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676310867011.f19921593afbd7b00a7e7155a8bb7bf1. 2023-02-13 17:54:33,106 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676310867011.f19921593afbd7b00a7e7155a8bb7bf1. started... 2023-02-13 17:54:33,106 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f19921593afbd7b00a7e7155a8bb7bf1 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 17:54:33,125 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010111dc3ebf53d54adcbb3c559008fe5ea1 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010111dc3ebf53d54adcbb3c559008fe5ea1 2023-02-13 17:54:33,534 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/.tmp/family1/4c64aa4c96c24dbca35f7cb300dba198 2023-02-13 17:54:33,539 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/.tmp/family1/4c64aa4c96c24dbca35f7cb300dba198 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/4c64aa4c96c24dbca35f7cb300dba198 2023-02-13 17:54:33,542 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/4c64aa4c96c24dbca35f7cb300dba198, entries=1, sequenceid=29, filesize=4.9 K 2023-02-13 17:54:33,543 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f19921593afbd7b00a7e7155a8bb7bf1 in 437ms, sequenceid=29, compaction requested=true 2023-02-13 17:54:33,543 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f19921593afbd7b00a7e7155a8bb7bf1: 2023-02-13 17:54:33,543 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676310867011.f19921593afbd7b00a7e7155a8bb7bf1. 2023-02-13 17:54:33,543 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:54:33,544 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:54:33,544 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:33,544 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 17:54:33,544 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-13 17:54:33,546 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:33,546 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:33,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:33,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:33,546 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:33,546 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:54:33,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:33,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:33,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:33,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:33,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:33,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:33,547 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 17:54:33,547 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@62464657[Count = 0] remaining members to acquire global barrier 2023-02-13 17:54:33,547 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 17:54:33,548 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:33,549 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:33,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:33,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:33,549 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 17:54:33,549 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-13 17:54:33,549 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:54:33,549 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:33,549 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:54:33,551 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 17:54:33,551 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:33,551 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:33,551 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-13 17:54:33,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:33,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:33,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:33,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:33,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:33,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:33,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:33,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:33,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:33,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:33,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:54:33,553 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 17:54:33,553 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-13 17:54:33,554 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:54:33,554 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:54:33,554 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:33,554 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:54:33,555 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:33,555 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:33,555 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:33,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:33,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:33,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:33,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:33,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:33,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:33,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:33,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:33,555 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:33,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:33,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:33,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:33,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:33,557 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:33,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:33,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:33,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:33,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:33,562 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:33,563 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:33,563 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:33,563 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:33,563 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:33,563 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:33,562 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:33,563 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:33,563 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 17:54:33,563 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:54:33,563 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:33,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:33,563 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:33,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:33,563 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 17:54:33,563 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 17:54:33,563 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:54:33,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:33,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:33,663 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:54:33,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:54:33,669 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:54:33,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 17:54:33,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:33,670 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 17:54:33,670 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:33,670 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 17:54:33,670 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 17:54:33,671 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:33,671 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:33,672 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:33,672 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:33,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:33,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:33,672 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:33,673 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:54:33,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:33,673 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:33,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:54:33,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:33,673 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:33,673 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 17:54:33,673 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:33,673 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 17:54:33,674 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:33,674 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 17:54:33,674 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:54:33,674 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:54:33,674 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676310867011.f19921593afbd7b00a7e7155a8bb7bf1. 2023-02-13 17:54:33,674 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676310867011.f19921593afbd7b00a7e7155a8bb7bf1. started... 2023-02-13 17:54:33,674 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f19921593afbd7b00a7e7155a8bb7bf1 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 17:54:34,089 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103fc9bc92896d54590a6361ac72a01f44b to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103fc9bc92896d54590a6361ac72a01f44b 2023-02-13 17:54:34,498 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/.tmp/family1/c061470c28e5480e8288fee69e9820dd 2023-02-13 17:54:34,504 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/.tmp/family1/c061470c28e5480e8288fee69e9820dd as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/c061470c28e5480e8288fee69e9820dd 2023-02-13 17:54:34,509 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/c061470c28e5480e8288fee69e9820dd, entries=1, sequenceid=33, filesize=4.9 K 2023-02-13 17:54:34,510 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f19921593afbd7b00a7e7155a8bb7bf1 in 836ms, sequenceid=33, compaction requested=true 2023-02-13 17:54:34,510 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f19921593afbd7b00a7e7155a8bb7bf1: 2023-02-13 17:54:34,510 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676310867011.f19921593afbd7b00a7e7155a8bb7bf1. 2023-02-13 17:54:34,510 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:54:34,510 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:54:34,510 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:34,510 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 17:54:34,510 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-13 17:54:34,512 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:34,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:34,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:34,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:34,512 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:34,512 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:34,512 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:54:34,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:34,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:34,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:34,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:34,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:34,514 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 17:54:34,514 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@57b45aa2[Count = 0] remaining members to acquire global barrier 2023-02-13 17:54:34,514 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 17:54:34,514 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:34,515 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:34,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:34,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:34,516 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 17:54:34,516 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-13 17:54:34,516 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:54:34,516 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:34,516 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:54:34,518 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 17:54:34,518 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:34,518 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:34,518 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-13 17:54:34,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:34,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:34,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:34,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:34,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:34,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:34,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:34,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:34,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:34,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:34,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:54:34,521 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 17:54:34,521 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-13 17:54:34,522 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:54:34,522 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:54:34,522 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:34,522 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:54:34,523 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:34,523 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:34,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:34,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:34,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:34,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:34,523 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:34,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:34,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:34,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:34,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:34,524 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:34,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:34,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:34,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:34,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:34,525 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:34,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:34,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:34,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:34,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:34,528 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:34,528 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:34,528 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:34,528 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:34,528 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 17:54:34,528 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:54:34,528 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:34,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:34,528 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:34,528 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:34,528 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:34,528 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 17:54:34,528 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 17:54:34,528 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:34,528 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:54:34,528 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:34,528 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:34,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:34,528 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:34,628 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:54:34,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:54:34,633 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:54:34,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 17:54:34,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:34,635 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 17:54:34,635 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:34,635 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 17:54:34,635 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 17:54:34,635 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:34,635 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:34,636 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:34,636 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:34,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:34,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:34,637 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:34,637 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:54:34,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:34,637 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:34,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:54:34,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:34,637 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:34,638 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 17:54:34,638 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:34,638 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 17:54:34,638 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:34,638 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 17:54:34,638 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:54:34,638 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:54:34,638 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676310867011.f19921593afbd7b00a7e7155a8bb7bf1. 2023-02-13 17:54:34,638 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676310867011.f19921593afbd7b00a7e7155a8bb7bf1. started... 2023-02-13 17:54:34,638 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f19921593afbd7b00a7e7155a8bb7bf1 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 17:54:35,050 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509079533e68963584312a23654d3148ada92 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201509079533e68963584312a23654d3148ada92 2023-02-13 17:54:35,456 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/.tmp/family1/c97207fd9e2645b5bccfde27fa18ae6a 2023-02-13 17:54:35,461 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/.tmp/family1/c97207fd9e2645b5bccfde27fa18ae6a as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/c97207fd9e2645b5bccfde27fa18ae6a 2023-02-13 17:54:35,466 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/c97207fd9e2645b5bccfde27fa18ae6a, entries=1, sequenceid=37, filesize=4.9 K 2023-02-13 17:54:35,467 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f19921593afbd7b00a7e7155a8bb7bf1 in 829ms, sequenceid=37, compaction requested=true 2023-02-13 17:54:35,467 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f19921593afbd7b00a7e7155a8bb7bf1: 2023-02-13 17:54:35,467 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676310867011.f19921593afbd7b00a7e7155a8bb7bf1. 2023-02-13 17:54:35,467 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:54:35,467 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:54:35,467 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:35,467 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 17:54:35,467 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-13 17:54:35,474 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:35,474 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:35,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:35,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:35,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:35,475 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:35,475 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:54:35,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:35,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:35,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:35,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:35,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:35,477 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 17:54:35,477 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@55159d08[Count = 0] remaining members to acquire global barrier 2023-02-13 17:54:35,477 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 17:54:35,477 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:35,478 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:35,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:35,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:35,478 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 17:54:35,478 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-13 17:54:35,478 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:54:35,478 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:35,478 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:54:35,480 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 17:54:35,480 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:35,480 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:35,480 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-13 17:54:35,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:35,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:35,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:35,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:35,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:35,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:35,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:35,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:35,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:35,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:35,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:54:35,483 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 17:54:35,483 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-13 17:54:35,483 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:54:35,483 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:54:35,483 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:35,483 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:54:35,485 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:35,485 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:35,485 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:35,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:35,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:35,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:35,485 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:35,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:35,485 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:35,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:35,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:35,485 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:35,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:35,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:35,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:35,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:35,486 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:35,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:35,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:35,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:35,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:35,490 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:35,490 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:35,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:35,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:35,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:35,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:35,494 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:35,494 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:35,494 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:35,494 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:35,494 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 17:54:35,494 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:54:35,494 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:35,494 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:35,494 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:35,494 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:35,494 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 17:54:35,494 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:54:35,594 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:54:35,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:54:35,600 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:54:35,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 17:54:35,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:35,602 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 17:54:35,602 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:35,602 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 17:54:35,602 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 17:54:35,603 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:35,603 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:35,605 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:35,605 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:35,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:35,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:35,605 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:35,605 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:54:35,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:35,605 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:35,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:54:35,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:35,606 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:35,606 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 17:54:35,606 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:35,606 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 17:54:35,606 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:35,606 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 17:54:35,606 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:54:35,606 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:54:35,606 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676310867011.f19921593afbd7b00a7e7155a8bb7bf1. 2023-02-13 17:54:35,606 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676310867011.f19921593afbd7b00a7e7155a8bb7bf1. started... 2023-02-13 17:54:35,606 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f19921593afbd7b00a7e7155a8bb7bf1 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 17:54:36,027 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112019cebf30cf7345bfba1338f534ae17c1 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015112019cebf30cf7345bfba1338f534ae17c1 2023-02-13 17:54:36,033 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/.tmp/family1/9ed516ac796f45fc885358b8f92df167 2023-02-13 17:54:36,038 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/.tmp/family1/9ed516ac796f45fc885358b8f92df167 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/9ed516ac796f45fc885358b8f92df167 2023-02-13 17:54:36,045 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/9ed516ac796f45fc885358b8f92df167, entries=1, sequenceid=41, filesize=4.9 K 2023-02-13 17:54:36,046 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f19921593afbd7b00a7e7155a8bb7bf1 in 440ms, sequenceid=41, compaction requested=true 2023-02-13 17:54:36,046 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f19921593afbd7b00a7e7155a8bb7bf1: 2023-02-13 17:54:36,046 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676310867011.f19921593afbd7b00a7e7155a8bb7bf1. 2023-02-13 17:54:36,046 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:54:36,046 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:54:36,046 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:36,046 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 17:54:36,046 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-13 17:54:36,048 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:36,048 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:36,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:36,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:36,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:36,048 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:36,048 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:54:36,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:36,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:36,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:36,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:36,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:36,050 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 17:54:36,050 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2de1a5c7[Count = 0] remaining members to acquire global barrier 2023-02-13 17:54:36,050 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 17:54:36,050 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:36,051 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:36,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:36,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:36,051 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 17:54:36,051 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-13 17:54:36,052 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:54:36,052 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:36,052 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:54:36,055 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:36,055 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 17:54:36,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:36,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:36,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:36,055 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:36,056 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-13 17:54:36,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:36,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:36,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:36,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:36,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:36,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:36,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:36,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:54:36,058 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 17:54:36,058 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-13 17:54:36,059 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:54:36,059 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:54:36,059 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:36,059 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:54:36,060 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:36,060 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:36,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:36,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:36,060 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:36,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:36,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:36,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:36,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:36,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:36,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:36,061 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:36,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:36,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:36,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:36,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:36,062 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:36,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:36,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:36,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:36,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:36,067 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:36,067 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:36,067 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:36,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:36,067 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:36,067 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:36,067 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 17:54:36,067 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:54:36,067 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:36,067 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 17:54:36,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:36,068 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:36,068 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:36,068 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:36,068 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:36,068 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 17:54:36,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:36,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:36,068 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:54:36,168 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:54:36,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:54:36,170 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41433] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyPolicy 2023-02-13 17:54:36,172 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] procedure2.ProcedureExecutor(1029): Stored pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-13 17:54:36,172 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-13 17:54:36,173 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 17:54:36,173 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=38, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676311476173 2023-02-13 17:54:36,175 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-13 17:54:36,176 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyPolicy' and column 'family1' 2023-02-13 17:54:36,176 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-13 17:54:36,176 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] zookeeper.ReadOnlyZKClient(139): Connect 0x7fc51d06 to 127.0.0.1:64825 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 17:54:36,186 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@26261665, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 17:54:36,186 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 17:54:36,625 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103d7588723d6ae41fca69ce04e358355a5 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103d7588723d6ae41fca69ce04e358355a5 2023-02-13 17:54:36,626 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-13 17:54:36,638 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 17:54:36,639 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57758, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 17:54:36,645 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 17:54:36,646 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60988, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 17:54:36,655 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/94261c9551b747b7a4656e81ba088815 first=Optional[r3] last=Optional[r6] 2023-02-13 17:54:36,656 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1676310867011.f19921593afbd7b00a7e7155a8bb7bf1., hostname=jenkins-hbase4.apache.org,38881,1676310818035, seqNum=2 for row with hfile group [{family1,hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/94261c9551b747b7a4656e81ba088815}] 2023-02-13 17:54:36,661 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(763): Validating hfile at hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/94261c9551b747b7a4656e81ba088815 for inclusion in f19921593afbd7b00a7e7155a8bb7bf1/family1 2023-02-13 17:54:36,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-13 17:54:36,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 17:54:36,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegion(2445): Flush status journal for f19921593afbd7b00a7e7155a8bb7bf1: 2023-02-13 17:54:36,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/94261c9551b747b7a4656e81ba088815 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithWeeklyPolicy__l2tk6id47v4q0hdk6jp81c59ghub9s0335s4fv1ffc6nf6vjp31o609ri9umps2g/family1/94261c9551b747b7a4656e81ba088815 2023-02-13 17:54:36,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithWeeklyPolicy__l2tk6id47v4q0hdk6jp81c59ghub9s0335s4fv1ffc6nf6vjp31o609ri9umps2g/family1/94261c9551b747b7a4656e81ba088815 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/f3d74446560d47b2bf7478963bcebdcb_SeqId_44_ 2023-02-13 17:54:36,668 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(849): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithWeeklyPolicy__l2tk6id47v4q0hdk6jp81c59ghub9s0335s4fv1ffc6nf6vjp31o609ri9umps2g/family1/94261c9551b747b7a4656e81ba088815 into f19921593afbd7b00a7e7155a8bb7bf1/family1 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/f3d74446560d47b2bf7478963bcebdcb_SeqId_44_ - updating store file list. 2023-02-13 17:54:36,671 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(882): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/f3d74446560d47b2bf7478963bcebdcb_SeqId_44_ into f19921593afbd7b00a7e7155a8bb7bf1/family1 2023-02-13 17:54:36,671 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(855): Successfully loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithWeeklyPolicy__l2tk6id47v4q0hdk6jp81c59ghub9s0335s4fv1ffc6nf6vjp31o609ri9umps2g/family1/94261c9551b747b7a4656e81ba088815 into f19921593afbd7b00a7e7155a8bb7bf1/family1 (new location: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/f3d74446560d47b2bf7478963bcebdcb_SeqId_44_) 2023-02-13 17:54:36,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithWeeklyPolicy__l2tk6id47v4q0hdk6jp81c59ghub9s0335s4fv1ffc6nf6vjp31o609ri9umps2g/family1/94261c9551b747b7a4656e81ba088815 2023-02-13 17:54:36,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-13 17:54:36,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-13 17:54:36,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(1912): f19921593afbd7b00a7e7155a8bb7bf1/family1 is initiating minor compaction 2023-02-13 17:54:36,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7dcce6e0; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 17:54:36,674 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of f19921593afbd7b00a7e7155a8bb7bf1/family1 in testMajorCompactionWithWeeklyPolicy,,1676310867011.f19921593afbd7b00a7e7155a8bb7bf1. 2023-02-13 17:54:36,675 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/4790d383f1f7406d9ae974015b1059ba, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/2b8d478d97b74e57a0173b33b2014f06, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/a4e4e7fda9874f17a9addeeea328b0b6, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/84afb6046ac34f9888be2e5a35b9b654, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/824fd9db7f284cceb4d0cbf45fb66110, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/4c64aa4c96c24dbca35f7cb300dba198, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/c061470c28e5480e8288fee69e9820dd, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/c97207fd9e2645b5bccfde27fa18ae6a, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/9ed516ac796f45fc885358b8f92df167, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/f3d74446560d47b2bf7478963bcebdcb_SeqId_44_] into tmpdir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/.tmp, totalSize=50.0 K 2023-02-13 17:54:36,675 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting 4790d383f1f7406d9ae974015b1059ba, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-13 17:54:36,675 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting 2b8d478d97b74e57a0173b33b2014f06, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-13 17:54:36,675 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting a4e4e7fda9874f17a9addeeea328b0b6, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-13 17:54:36,675 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting 84afb6046ac34f9888be2e5a35b9b654, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-13 17:54:36,675 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting 824fd9db7f284cceb4d0cbf45fb66110, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-13 17:54:36,675 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting 4c64aa4c96c24dbca35f7cb300dba198, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-13 17:54:36,675 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting c061470c28e5480e8288fee69e9820dd, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-13 17:54:36,675 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting c97207fd9e2645b5bccfde27fa18ae6a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-13 17:54:36,675 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting 9ed516ac796f45fc885358b8f92df167, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-13 17:54:36,675 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting f3d74446560d47b2bf7478963bcebdcb_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-13 17:54:36,677 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-13 17:54:36,678 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:54:36,679 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015122823337c12968f4a5ea6cf9cdd9519da9d to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015122823337c12968f4a5ea6cf9cdd9519da9d 2023-02-13 17:54:36,681 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512319c729c0da3dd4b05b10999357d5e0ec0 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512319c729c0da3dd4b05b10999357d5e0ec0 2023-02-13 17:54:36,682 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010111dc3ebf53d54adcbb3c559008fe5ea1 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010111dc3ebf53d54adcbb3c559008fe5ea1 2023-02-13 17:54:36,683 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103fc9bc92896d54590a6361ac72a01f44b to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103fc9bc92896d54590a6361ac72a01f44b 2023-02-13 17:54:36,683 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-02-13 17:54:36,683 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-13 17:54:36,683 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 17:54:36,683 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 17:54:36,684 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 17:54:36,684 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 17:54:36,684 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 17:54:36,684 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 17:54:36,684 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 17:54:36,684 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 17:54:36,707 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] throttle.PressureAwareThroughputController(145): f19921593afbd7b00a7e7155a8bb7bf1#family1#compaction#49 average throughput is 1.36 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 17:54:37,523 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/.tmp/family1/03008f88e9a14308b6146e41cdb3104e as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/03008f88e9a14308b6146e41cdb3104e 2023-02-13 17:54:37,528 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in f19921593afbd7b00a7e7155a8bb7bf1/family1 of f19921593afbd7b00a7e7155a8bb7bf1 into 03008f88e9a14308b6146e41cdb3104e(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 17:54:37,528 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for f19921593afbd7b00a7e7155a8bb7bf1: 2023-02-13 17:54:37,528 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1676310867011.f19921593afbd7b00a7e7155a8bb7bf1., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1676310876674; duration=0sec 2023-02-13 17:54:37,528 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 17:54:37,537 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512051a75f2696e5b4881827c82071b10db73 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512051a75f2696e5b4881827c82071b10db73 2023-02-13 17:54:37,538 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-13 17:54:37,561 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/c6fb92ebbd4944dda1a0adf176807320 first=Optional[r00] last=Optional[r2] 2023-02-13 17:54:37,562 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1676310867011.f19921593afbd7b00a7e7155a8bb7bf1., hostname=jenkins-hbase4.apache.org,38881,1676310818035, seqNum=2 for row with hfile group [{family1,hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/c6fb92ebbd4944dda1a0adf176807320}] 2023-02-13 17:54:37,565 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(763): Validating hfile at hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/c6fb92ebbd4944dda1a0adf176807320 for inclusion in f19921593afbd7b00a7e7155a8bb7bf1/family1 2023-02-13 17:54:37,573 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/4790d383f1f7406d9ae974015b1059ba, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/2b8d478d97b74e57a0173b33b2014f06, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/a4e4e7fda9874f17a9addeeea328b0b6, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/84afb6046ac34f9888be2e5a35b9b654, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/824fd9db7f284cceb4d0cbf45fb66110, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/4c64aa4c96c24dbca35f7cb300dba198, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/c061470c28e5480e8288fee69e9820dd, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/c97207fd9e2645b5bccfde27fa18ae6a, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/9ed516ac796f45fc885358b8f92df167, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/f3d74446560d47b2bf7478963bcebdcb_SeqId_44_] to archive 2023-02-13 17:54:37,573 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:54:37,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-02-13 17:54:37,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 17:54:37,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegion(2445): Flush status journal for f19921593afbd7b00a7e7155a8bb7bf1: 2023-02-13 17:54:37,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/c6fb92ebbd4944dda1a0adf176807320 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithWeeklyPolicy__56sd8qdma37lr0d1fflj6m66guf749f50je473q3ne95vu84vch67reibj2vdfcs/family1/c6fb92ebbd4944dda1a0adf176807320 2023-02-13 17:54:37,575 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/4790d383f1f7406d9ae974015b1059ba to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/4790d383f1f7406d9ae974015b1059ba 2023-02-13 17:54:37,576 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/2b8d478d97b74e57a0173b33b2014f06 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/2b8d478d97b74e57a0173b33b2014f06 2023-02-13 17:54:37,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithWeeklyPolicy__56sd8qdma37lr0d1fflj6m66guf749f50je473q3ne95vu84vch67reibj2vdfcs/family1/c6fb92ebbd4944dda1a0adf176807320 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/e844f6160f154997bbd244409d3119fe_SeqId_47_ 2023-02-13 17:54:37,578 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(849): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithWeeklyPolicy__56sd8qdma37lr0d1fflj6m66guf749f50je473q3ne95vu84vch67reibj2vdfcs/family1/c6fb92ebbd4944dda1a0adf176807320 into f19921593afbd7b00a7e7155a8bb7bf1/family1 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/e844f6160f154997bbd244409d3119fe_SeqId_47_ - updating store file list. 2023-02-13 17:54:37,578 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/a4e4e7fda9874f17a9addeeea328b0b6 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/a4e4e7fda9874f17a9addeeea328b0b6 2023-02-13 17:54:37,579 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/84afb6046ac34f9888be2e5a35b9b654 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/84afb6046ac34f9888be2e5a35b9b654 2023-02-13 17:54:37,581 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(882): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/e844f6160f154997bbd244409d3119fe_SeqId_47_ into f19921593afbd7b00a7e7155a8bb7bf1/family1 2023-02-13 17:54:37,582 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(855): Successfully loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithWeeklyPolicy__56sd8qdma37lr0d1fflj6m66guf749f50je473q3ne95vu84vch67reibj2vdfcs/family1/c6fb92ebbd4944dda1a0adf176807320 into f19921593afbd7b00a7e7155a8bb7bf1/family1 (new location: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/e844f6160f154997bbd244409d3119fe_SeqId_47_) 2023-02-13 17:54:37,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithWeeklyPolicy__56sd8qdma37lr0d1fflj6m66guf749f50je473q3ne95vu84vch67reibj2vdfcs/family1/c6fb92ebbd4944dda1a0adf176807320 2023-02-13 17:54:37,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-13 17:54:37,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 345120 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-13 17:54:37,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(1912): f19921593afbd7b00a7e7155a8bb7bf1/family1 is initiating minor compaction (all files) 2023-02-13 17:54:37,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@14534258; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 17:54:37,583 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of f19921593afbd7b00a7e7155a8bb7bf1/family1 in testMajorCompactionWithWeeklyPolicy,,1676310867011.f19921593afbd7b00a7e7155a8bb7bf1. 2023-02-13 17:54:37,584 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/4492cc69f63445f5b7cad5aa31c68cdb, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/03008f88e9a14308b6146e41cdb3104e, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/e844f6160f154997bbd244409d3119fe_SeqId_47_] into tmpdir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/.tmp, totalSize=337.0 K 2023-02-13 17:54:37,584 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting 4492cc69f63445f5b7cad5aa31c68cdb, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878841551 2023-02-13 17:54:37,584 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/824fd9db7f284cceb4d0cbf45fb66110 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/824fd9db7f284cceb4d0cbf45fb66110 2023-02-13 17:54:37,584 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting 03008f88e9a14308b6146e41cdb3104e, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621241551 2023-02-13 17:54:37,585 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting e844f6160f154997bbd244409d3119fe_SeqId_47_, keycount=1002, bloomtype=ROW, size=165.4 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878841551 2023-02-13 17:54:37,586 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/4c64aa4c96c24dbca35f7cb300dba198 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/4c64aa4c96c24dbca35f7cb300dba198 2023-02-13 17:54:37,586 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-13 17:54:37,587 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:54:37,587 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/c061470c28e5480e8288fee69e9820dd to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/c061470c28e5480e8288fee69e9820dd 2023-02-13 17:54:37,589 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/c97207fd9e2645b5bccfde27fa18ae6a to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/c97207fd9e2645b5bccfde27fa18ae6a 2023-02-13 17:54:37,590 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130bf2fce86375343a1b870b30fb15c058d to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130bf2fce86375343a1b870b30fb15c058d 2023-02-13 17:54:37,591 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/9ed516ac796f45fc885358b8f92df167 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/9ed516ac796f45fc885358b8f92df167 2023-02-13 17:54:37,591 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015120127f90f7363dd41c5a4f75bf9990c0e1b to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015120127f90f7363dd41c5a4f75bf9990c0e1b 2023-02-13 17:54:37,592 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/f3d74446560d47b2bf7478963bcebdcb_SeqId_44_ to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/f3d74446560d47b2bf7478963bcebdcb_SeqId_44_ 2023-02-13 17:54:37,592 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015120518658e9ca70d4f139121cb754500a731 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015120518658e9ca70d4f139121cb754500a731 2023-02-13 17:54:37,592 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 3 expired mob files are deleted 2023-02-13 17:54:37,593 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-13 17:54:37,593 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 17:54:37,593 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-13 17:54:37,593 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 17:54:37,594 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=38, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-13 17:54:37,596 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=38, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.4230 sec 2023-02-13 17:54:37,608 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] throttle.PressureAwareThroughputController(145): f19921593afbd7b00a7e7155a8bb7bf1#family1#compaction#50 average throughput is 15.46 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 17:54:37,636 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/.tmp/family1/e5eb51d8451d40b8a89ed8addbd5c2c4 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/e5eb51d8451d40b8a89ed8addbd5c2c4 2023-02-13 17:54:37,643 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in f19921593afbd7b00a7e7155a8bb7bf1/family1 of f19921593afbd7b00a7e7155a8bb7bf1 into e5eb51d8451d40b8a89ed8addbd5c2c4(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 17:54:37,643 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for f19921593afbd7b00a7e7155a8bb7bf1: 2023-02-13 17:54:37,643 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1676310867011.f19921593afbd7b00a7e7155a8bb7bf1., storeName=family1, fileCount=3, fileSize=337.0 K (165.1 K, 6.6 K, 165.4 K), priority=2, time=1676310877583; duration=0sec 2023-02-13 17:54:37,643 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 17:54:37,661 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/4492cc69f63445f5b7cad5aa31c68cdb, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/03008f88e9a14308b6146e41cdb3104e, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/e844f6160f154997bbd244409d3119fe_SeqId_47_] to archive 2023-02-13 17:54:37,662 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:54:37,664 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/4492cc69f63445f5b7cad5aa31c68cdb to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/4492cc69f63445f5b7cad5aa31c68cdb 2023-02-13 17:54:37,665 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/03008f88e9a14308b6146e41cdb3104e to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/03008f88e9a14308b6146e41cdb3104e 2023-02-13 17:54:37,667 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/e844f6160f154997bbd244409d3119fe_SeqId_47_ to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/family1/e844f6160f154997bbd244409d3119fe_SeqId_47_ 2023-02-13 17:54:37,700 INFO [Listener at localhost/35343] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=249 (was 249), OpenFileDescriptor=610 (was 598) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=247 (was 283), ProcessCount=168 (was 168), AvailableMemoryMB=1151 (was 1305) 2023-02-13 17:54:37,713 INFO [Listener at localhost/35343] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=249, OpenFileDescriptor=610, MaxFileDescriptor=60000, SystemLoadAverage=247, ProcessCount=168, AvailableMemoryMB=1150 2023-02-13 17:54:37,715 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-13 17:54:37,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure2.ProcedureExecutor(1029): Stored pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:37,717 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 17:54:37,718 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly" procId is: 39 2023-02-13 17:54:37,718 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 17:54:37,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-13 17:54:37,720 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9 2023-02-13 17:54:37,720 DEBUG [HFileArchiver-9] backup.HFileArchiver(153): Directory hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9 empty. 2023-02-13 17:54:37,721 DEBUG [HFileArchiver-9] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9 2023-02-13 17:54:37,721 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly regions 2023-02-13 17:54:37,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-13 17:54:38,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-13 17:54:38,129 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-02-13 17:54:38,130 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(7671): creating {ENCODED => c963ca8c1a0836a4d54901641d03d8f9, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp 2023-02-13 17:54:38,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-13 17:54:38,536 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 17:54:38,536 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1603): Closing c963ca8c1a0836a4d54901641d03d8f9, disabling compactions & flushes 2023-02-13 17:54:38,536 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9. 2023-02-13 17:54:38,537 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9. 2023-02-13 17:54:38,537 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9. after waiting 0 ms 2023-02-13 17:54:38,537 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9. 2023-02-13 17:54:38,537 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9. 2023-02-13 17:54:38,537 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1557): Region close journal for c963ca8c1a0836a4d54901641d03d8f9: Waiting for close lock at 1676310878536Disabling compacts and flushes for region at 1676310878536Disabling writes for close at 1676310878537 (+1 ms)Writing region close event to WAL at 1676310878537Closed at 1676310878537 2023-02-13 17:54:38,539 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 17:54:38,540 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676310878540"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676310878540"}]},"ts":"1676310878540"} 2023-02-13 17:54:38,541 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 17:54:38,542 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 17:54:38,542 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676310878542"}]},"ts":"1676310878542"} 2023-02-13 17:54:38,543 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLING in hbase:meta 2023-02-13 17:54:38,546 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=c963ca8c1a0836a4d54901641d03d8f9, ASSIGN}] 2023-02-13 17:54:38,548 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=c963ca8c1a0836a4d54901641d03d8f9, ASSIGN 2023-02-13 17:54:38,549 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=c963ca8c1a0836a4d54901641d03d8f9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38881,1676310818035; forceNewPlan=false, retain=false 2023-02-13 17:54:38,700 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=c963ca8c1a0836a4d54901641d03d8f9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:38,700 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676310878700"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676310878700"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676310878700"}]},"ts":"1676310878700"} 2023-02-13 17:54:38,702 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=41, ppid=40, state=RUNNABLE; OpenRegionProcedure c963ca8c1a0836a4d54901641d03d8f9, server=jenkins-hbase4.apache.org,38881,1676310818035}] 2023-02-13 17:54:38,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-13 17:54:38,857 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9. 2023-02-13 17:54:38,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c963ca8c1a0836a4d54901641d03d8f9, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9.', STARTKEY => '', ENDKEY => ''} 2023-02-13 17:54:38,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly c963ca8c1a0836a4d54901641d03d8f9 2023-02-13 17:54:38,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 17:54:38,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c963ca8c1a0836a4d54901641d03d8f9 2023-02-13 17:54:38,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c963ca8c1a0836a4d54901641d03d8f9 2023-02-13 17:54:38,859 INFO [StoreOpener-c963ca8c1a0836a4d54901641d03d8f9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c963ca8c1a0836a4d54901641d03d8f9 2023-02-13 17:54:38,860 DEBUG [StoreOpener-c963ca8c1a0836a4d54901641d03d8f9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1 2023-02-13 17:54:38,860 DEBUG [StoreOpener-c963ca8c1a0836a4d54901641d03d8f9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1 2023-02-13 17:54:38,860 INFO [StoreOpener-c963ca8c1a0836a4d54901641d03d8f9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c963ca8c1a0836a4d54901641d03d8f9 columnFamilyName family1 2023-02-13 17:54:38,862 INFO [StoreOpener-c963ca8c1a0836a4d54901641d03d8f9-1] regionserver.HStore(310): Store=c963ca8c1a0836a4d54901641d03d8f9/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 17:54:38,863 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9 2023-02-13 17:54:38,863 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9 2023-02-13 17:54:38,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c963ca8c1a0836a4d54901641d03d8f9 2023-02-13 17:54:38,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 17:54:38,869 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c963ca8c1a0836a4d54901641d03d8f9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73555584, jitterRate=0.09606361389160156}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 17:54:38,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c963ca8c1a0836a4d54901641d03d8f9: Running coprocessor pre-open hook at 1676310878858Writing region info on filesystem at 1676310878858Initializing all the Stores at 1676310878858Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1676310878858Cleaning up temporary data from old regions at 1676310878863 (+5 ms)Cleaning up detritus from prior splits at 1676310878864 (+1 ms)Running coprocessor post-open hooks at 1676310878870 (+6 ms)Region opened successfully at 1676310878870 2023-02-13 17:54:38,870 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9., pid=41, masterSystemTime=1676310878854 2023-02-13 17:54:38,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9. 2023-02-13 17:54:38,872 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9. 2023-02-13 17:54:38,873 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=c963ca8c1a0836a4d54901641d03d8f9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:38,873 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676310878873"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676310878873"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676310878873"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676310878873"}]},"ts":"1676310878873"} 2023-02-13 17:54:38,875 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=41, resume processing ppid=40 2023-02-13 17:54:38,876 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=40, state=SUCCESS; OpenRegionProcedure c963ca8c1a0836a4d54901641d03d8f9, server=jenkins-hbase4.apache.org,38881,1676310818035 in 172 msec 2023-02-13 17:54:38,877 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=39 2023-02-13 17:54:38,877 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=c963ca8c1a0836a4d54901641d03d8f9, ASSIGN in 330 msec 2023-02-13 17:54:38,878 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 17:54:38,878 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676310878878"}]},"ts":"1676310878878"} 2023-02-13 17:54:38,879 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLED in hbase:meta 2023-02-13 17:54:38,883 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 17:54:38,885 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=39, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.1680 sec 2023-02-13 17:54:39,345 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-02-13 17:54:39,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-13 17:54:39,823 INFO [Listener at localhost/35343] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, procId: 39 completed 2023-02-13 17:54:39,842 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:54:39,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:39,843 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 17:54:39,843 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:39,843 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-13 17:54:39,843 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-13 17:54:39,844 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:39,844 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:39,846 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:39,846 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:39,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:39,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:39,846 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:39,846 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:54:39,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:39,846 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:39,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:54:39,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:39,847 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:39,847 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:39,847 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-13 17:54:39,847 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:39,847 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-13 17:54:39,847 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:54:39,847 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:54:39,847 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9. 2023-02-13 17:54:39,847 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9. started... 2023-02-13 17:54:39,848 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c963ca8c1a0836a4d54901641d03d8f9 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-13 17:54:39,952 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 17:54:40,269 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130bb87e4b52a284d82a4312c63036eb2d9 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130bb87e4b52a284d82a4312c63036eb2d9 2023-02-13 17:54:40,673 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/.tmp/family1/1147bc42a5384d8785a7ed9fb0544657 2023-02-13 17:54:40,677 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/.tmp/family1/1147bc42a5384d8785a7ed9fb0544657 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/1147bc42a5384d8785a7ed9fb0544657 2023-02-13 17:54:40,681 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/1147bc42a5384d8785a7ed9fb0544657, entries=1000, sequenceid=5, filesize=191.4 K 2023-02-13 17:54:40,682 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for c963ca8c1a0836a4d54901641d03d8f9 in 834ms, sequenceid=5, compaction requested=false 2023-02-13 17:54:40,683 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c963ca8c1a0836a4d54901641d03d8f9: 2023-02-13 17:54:40,683 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9. 2023-02-13 17:54:40,683 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:54:40,683 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:54:40,683 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:40,683 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-13 17:54:40,683 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-13 17:54:40,684 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:40,684 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:40,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:40,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:40,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:40,685 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:40,685 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:54:40,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:40,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:40,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:40,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:40,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:40,686 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-13 17:54:40,686 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7dc52ad2[Count = 0] remaining members to acquire global barrier 2023-02-13 17:54:40,686 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-13 17:54:40,686 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:40,687 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:40,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:40,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:40,687 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-13 17:54:40,687 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-13 17:54:40,687 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:54:40,687 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:40,687 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:54:40,689 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-13 17:54:40,689 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:40,689 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:40,689 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-13 17:54:40,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:40,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:40,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:40,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:40,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:40,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:40,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:40,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:40,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:40,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:40,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:54:40,691 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-13 17:54:40,691 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-13 17:54:40,691 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:54:40,691 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:54:40,691 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:40,691 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:54:40,693 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:40,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:40,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:40,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:40,694 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:40,694 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:40,694 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:40,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:40,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:40,694 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:40,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:40,694 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:40,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:40,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:40,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:40,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:40,695 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:40,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:40,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:40,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:40,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:40,697 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:40,697 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:40,697 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:40,697 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:40,697 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:40,697 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:40,697 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:40,697 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 17:54:40,697 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:54:40,697 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-13 17:54:40,697 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:40,697 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:40,698 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:40,697 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:40,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:40,698 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-13 17:54:40,698 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:54:40,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:40,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:40,798 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:54:40,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:54:40,803 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:54:40,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-13 17:54:40,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:40,805 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 17:54:40,805 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:40,805 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-13 17:54:40,805 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-13 17:54:40,805 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:40,805 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:40,807 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:40,807 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:40,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:40,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:40,807 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:40,807 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:54:40,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:40,807 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:40,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:54:40,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:40,808 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:40,808 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-13 17:54:40,808 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:40,808 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-13 17:54:40,808 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:40,808 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-13 17:54:40,808 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:54:40,808 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:54:40,808 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9. 2023-02-13 17:54:40,808 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9. started... 2023-02-13 17:54:40,809 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c963ca8c1a0836a4d54901641d03d8f9 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-13 17:54:41,220 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112844b9e479a3aa4151b1d9e5825da8ed00 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112844b9e479a3aa4151b1d9e5825da8ed00 2023-02-13 17:54:41,626 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/.tmp/family1/b9117707c2a84816aae39a40a3b92815 2023-02-13 17:54:41,631 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/.tmp/family1/b9117707c2a84816aae39a40a3b92815 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/b9117707c2a84816aae39a40a3b92815 2023-02-13 17:54:41,635 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/b9117707c2a84816aae39a40a3b92815, entries=1, sequenceid=9, filesize=5.0 K 2023-02-13 17:54:41,636 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for c963ca8c1a0836a4d54901641d03d8f9 in 827ms, sequenceid=9, compaction requested=false 2023-02-13 17:54:41,636 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c963ca8c1a0836a4d54901641d03d8f9: 2023-02-13 17:54:41,636 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9. 2023-02-13 17:54:41,636 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:54:41,636 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:54:41,636 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:41,636 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-13 17:54:41,636 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-13 17:54:41,638 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:41,638 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:41,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:41,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:41,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:41,638 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:41,638 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:54:41,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:41,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:41,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:41,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:41,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:41,639 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-13 17:54:41,639 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@8d10e82[Count = 0] remaining members to acquire global barrier 2023-02-13 17:54:41,639 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-13 17:54:41,640 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:41,642 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:41,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:41,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:41,642 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-13 17:54:41,642 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-13 17:54:41,642 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:54:41,642 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:41,642 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:54:41,643 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-13 17:54:41,643 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:41,643 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:41,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:41,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:41,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:41,644 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-13 17:54:41,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:41,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:41,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:41,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:41,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:41,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:41,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:41,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:54:41,646 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-13 17:54:41,646 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-13 17:54:41,646 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:54:41,646 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:54:41,646 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:41,646 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:54:41,647 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:41,647 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:41,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:41,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:41,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:41,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:41,647 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:41,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:41,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:41,648 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:41,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:41,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:41,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:41,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:41,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:41,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:41,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:41,649 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:41,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:41,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:41,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:41,655 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:41,655 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:41,655 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:41,655 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:41,655 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:41,655 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 17:54:41,655 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:54:41,655 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:41,655 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:41,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:41,655 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:41,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:41,655 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:41,655 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:41,655 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-13 17:54:41,655 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:54:41,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:41,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:41,755 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:54:41,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:54:41,760 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:54:41,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-13 17:54:41,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:41,762 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 17:54:41,762 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:41,762 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-13 17:54:41,762 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-13 17:54:41,762 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:41,763 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:41,764 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:41,764 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:41,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:41,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:41,764 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:41,764 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:54:41,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:41,764 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:41,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:54:41,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:41,765 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:41,765 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-13 17:54:41,765 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:41,765 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-13 17:54:41,765 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:41,765 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-13 17:54:41,765 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:54:41,765 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:54:41,765 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9. 2023-02-13 17:54:41,765 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9. started... 2023-02-13 17:54:41,765 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c963ca8c1a0836a4d54901641d03d8f9 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 17:54:42,181 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201c9e97fe8334a4e05aac15b588f331592 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201c9e97fe8334a4e05aac15b588f331592 2023-02-13 17:54:42,586 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/.tmp/family1/88c491803b064e86acec7ad0b77647c9 2023-02-13 17:54:42,590 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/.tmp/family1/88c491803b064e86acec7ad0b77647c9 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/88c491803b064e86acec7ad0b77647c9 2023-02-13 17:54:42,594 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/88c491803b064e86acec7ad0b77647c9, entries=1, sequenceid=13, filesize=5.0 K 2023-02-13 17:54:42,595 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c963ca8c1a0836a4d54901641d03d8f9 in 830ms, sequenceid=13, compaction requested=true 2023-02-13 17:54:42,595 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c963ca8c1a0836a4d54901641d03d8f9: 2023-02-13 17:54:42,595 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9. 2023-02-13 17:54:42,595 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:54:42,595 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:54:42,595 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:42,595 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-13 17:54:42,595 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-13 17:54:42,597 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:42,597 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:42,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:42,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:42,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:42,597 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:42,597 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:54:42,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:42,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:42,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:42,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:42,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:42,599 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-13 17:54:42,599 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@71552f4d[Count = 0] remaining members to acquire global barrier 2023-02-13 17:54:42,599 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-13 17:54:42,599 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:42,600 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:42,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:42,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:42,600 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-13 17:54:42,600 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-13 17:54:42,600 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:42,600 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:54:42,600 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:54:42,606 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:42,606 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-13 17:54:42,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:42,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:42,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:42,606 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:42,607 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-13 17:54:42,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:42,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:42,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:42,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:42,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:42,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:42,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:42,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:54:42,609 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-13 17:54:42,609 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-13 17:54:42,609 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:54:42,609 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:54:42,609 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:42,609 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:54:42,611 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:42,611 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:42,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:42,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:42,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:42,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:42,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:42,611 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:42,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:42,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:42,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:42,611 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:42,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:42,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:42,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:42,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:42,612 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:42,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:42,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:42,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:42,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:42,614 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:42,614 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:42,614 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:42,614 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:42,614 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-13 17:54:42,614 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:42,614 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 17:54:42,614 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:54:42,614 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:42,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:42,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:42,614 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:42,615 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:42,615 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:42,615 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:42,615 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-13 17:54:42,615 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:54:42,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:42,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:42,715 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:54:42,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:54:42,720 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:54:42,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-13 17:54:42,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:42,722 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 17:54:42,722 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:42,722 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-13 17:54:42,722 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-13 17:54:42,722 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:42,722 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:42,723 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:42,723 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:42,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:42,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:42,724 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:42,724 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:54:42,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:42,724 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:42,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:54:42,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:42,724 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:42,725 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-13 17:54:42,725 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:42,725 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-13 17:54:42,725 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:42,725 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-13 17:54:42,725 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:54:42,725 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:54:42,725 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9. 2023-02-13 17:54:42,725 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9. started... 2023-02-13 17:54:42,725 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c963ca8c1a0836a4d54901641d03d8f9 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 17:54:43,138 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205fe87b3b6d0564cf7994c9a1b0195f12f to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205fe87b3b6d0564cf7994c9a1b0195f12f 2023-02-13 17:54:43,543 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/.tmp/family1/f137b48d94284670af62a0934d9b90e5 2023-02-13 17:54:43,548 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/.tmp/family1/f137b48d94284670af62a0934d9b90e5 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/f137b48d94284670af62a0934d9b90e5 2023-02-13 17:54:43,552 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/f137b48d94284670af62a0934d9b90e5, entries=1, sequenceid=17, filesize=5.0 K 2023-02-13 17:54:43,553 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c963ca8c1a0836a4d54901641d03d8f9 in 828ms, sequenceid=17, compaction requested=true 2023-02-13 17:54:43,553 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c963ca8c1a0836a4d54901641d03d8f9: 2023-02-13 17:54:43,553 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9. 2023-02-13 17:54:43,553 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:54:43,553 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:54:43,553 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:43,553 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-13 17:54:43,553 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-13 17:54:43,556 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:43,556 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:43,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:43,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:43,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:43,556 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:43,556 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:54:43,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:43,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:43,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:43,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:43,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:43,557 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-13 17:54:43,558 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51ba733d[Count = 0] remaining members to acquire global barrier 2023-02-13 17:54:43,558 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-13 17:54:43,558 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:43,559 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:43,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:43,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:43,559 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-13 17:54:43,559 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-13 17:54:43,559 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:54:43,559 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:43,559 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:54:43,561 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-13 17:54:43,561 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:43,561 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:43,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:43,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:43,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:43,561 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-13 17:54:43,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:43,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:43,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:43,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:43,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:43,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:43,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:43,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:54:43,563 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-13 17:54:43,563 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-13 17:54:43,563 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:54:43,563 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:54:43,563 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:43,563 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:54:43,565 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:43,565 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:43,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:43,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:43,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:43,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:43,565 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:43,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:43,565 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:43,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:43,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:43,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:43,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:43,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:43,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:43,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:43,567 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:43,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:43,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:43,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:43,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:43,570 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:43,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:43,570 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:43,570 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 17:54:43,570 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:43,570 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:54:43,570 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-13 17:54:43,570 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:43,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:43,570 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:43,570 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:43,570 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:43,570 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-13 17:54:43,570 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:54:43,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:43,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:43,570 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:43,570 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:43,570 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:43,670 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:54:43,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:54:43,675 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:54:43,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-13 17:54:43,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:43,677 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 17:54:43,677 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:43,677 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-13 17:54:43,677 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-13 17:54:43,677 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:43,678 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:43,679 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:43,679 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:43,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:43,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:43,679 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:43,679 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:54:43,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:43,679 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:43,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:54:43,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:43,680 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:43,680 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-13 17:54:43,680 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:43,680 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-13 17:54:43,680 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:43,680 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-13 17:54:43,680 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:54:43,680 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:54:43,680 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9. 2023-02-13 17:54:43,680 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9. started... 2023-02-13 17:54:43,681 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c963ca8c1a0836a4d54901641d03d8f9 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 17:54:44,092 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512284f5ade47bb0946b889107ad798a62410 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512284f5ade47bb0946b889107ad798a62410 2023-02-13 17:54:44,386 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 17:54:44,498 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/.tmp/family1/fe67945711c84be8a90513879d796e79 2023-02-13 17:54:44,503 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/.tmp/family1/fe67945711c84be8a90513879d796e79 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/fe67945711c84be8a90513879d796e79 2023-02-13 17:54:44,507 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/fe67945711c84be8a90513879d796e79, entries=1, sequenceid=21, filesize=5.0 K 2023-02-13 17:54:44,508 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c963ca8c1a0836a4d54901641d03d8f9 in 827ms, sequenceid=21, compaction requested=true 2023-02-13 17:54:44,508 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c963ca8c1a0836a4d54901641d03d8f9: 2023-02-13 17:54:44,508 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9. 2023-02-13 17:54:44,508 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:54:44,508 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:54:44,508 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:44,508 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-13 17:54:44,508 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-13 17:54:44,513 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:44,513 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:44,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:44,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:44,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:44,514 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:44,514 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:54:44,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:44,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:44,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:44,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:44,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:44,515 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-13 17:54:44,515 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@57d5062[Count = 0] remaining members to acquire global barrier 2023-02-13 17:54:44,515 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-13 17:54:44,515 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:44,516 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:44,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:44,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:44,516 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-13 17:54:44,516 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-13 17:54:44,516 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:44,516 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:54:44,516 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:54:44,517 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-13 17:54:44,517 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:44,517 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:44,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:44,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:44,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:44,518 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-13 17:54:44,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:44,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:44,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:44,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:44,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:44,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:44,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:44,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:54:44,520 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-13 17:54:44,520 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-13 17:54:44,520 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:54:44,520 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:54:44,520 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:44,520 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:54:44,521 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:44,521 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:44,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:44,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:44,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:44,521 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:44,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:44,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:44,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:44,522 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:44,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:44,522 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:44,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:44,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:44,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:44,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:44,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:44,523 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:44,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:44,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:44,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:44,525 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:44,525 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:44,526 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:44,526 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:44,526 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:44,526 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:44,526 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:44,526 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:44,526 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:44,526 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 17:54:44,526 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:54:44,526 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:44,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:44,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:44,526 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-13 17:54:44,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:44,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:44,526 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:54:44,626 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:54:44,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:54:44,631 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:54:44,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-13 17:54:44,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:44,632 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 17:54:44,632 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:44,632 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-13 17:54:44,632 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-13 17:54:44,633 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:44,633 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:44,634 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:44,634 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:44,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:44,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:44,634 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:44,634 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:54:44,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:44,634 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:44,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:54:44,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:44,635 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:44,635 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-13 17:54:44,635 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:44,635 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-13 17:54:44,635 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:44,635 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-13 17:54:44,635 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:54:44,635 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:54:44,635 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9. 2023-02-13 17:54:44,635 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9. started... 2023-02-13 17:54:44,635 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c963ca8c1a0836a4d54901641d03d8f9 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 17:54:45,047 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512314de16ae2f68d46d599d6c49435001ac6 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512314de16ae2f68d46d599d6c49435001ac6 2023-02-13 17:54:45,453 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/.tmp/family1/78a813f90254432a82bee4db317ed153 2023-02-13 17:54:45,459 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/.tmp/family1/78a813f90254432a82bee4db317ed153 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/78a813f90254432a82bee4db317ed153 2023-02-13 17:54:45,463 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/78a813f90254432a82bee4db317ed153, entries=1, sequenceid=25, filesize=5.0 K 2023-02-13 17:54:45,464 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c963ca8c1a0836a4d54901641d03d8f9 in 829ms, sequenceid=25, compaction requested=true 2023-02-13 17:54:45,464 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c963ca8c1a0836a4d54901641d03d8f9: 2023-02-13 17:54:45,464 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9. 2023-02-13 17:54:45,464 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:54:45,464 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:54:45,464 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:45,464 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-13 17:54:45,464 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-13 17:54:45,466 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:45,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:45,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:45,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:45,466 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:45,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:45,467 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:45,467 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:54:45,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:45,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:45,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:45,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:45,468 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-13 17:54:45,468 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@558eb51[Count = 0] remaining members to acquire global barrier 2023-02-13 17:54:45,468 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-13 17:54:45,468 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:45,470 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:45,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:45,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:45,471 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-13 17:54:45,471 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-13 17:54:45,471 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:45,471 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:54:45,471 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:54:45,472 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-13 17:54:45,472 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:45,472 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:45,472 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-13 17:54:45,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:45,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:45,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:45,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:45,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:45,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:45,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:45,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:45,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:45,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:45,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:54:45,475 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-13 17:54:45,475 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-13 17:54:45,475 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:54:45,475 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:54:45,475 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:45,475 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:54:45,477 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:45,477 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:45,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:45,477 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:45,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:45,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:45,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:45,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:45,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:45,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:45,478 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:45,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:45,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:45,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:45,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:45,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:45,480 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:45,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:45,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:45,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:45,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:45,482 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:45,483 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:45,483 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:45,483 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:45,483 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:45,483 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:45,483 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:45,483 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 17:54:45,483 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:45,483 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:54:45,483 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-13 17:54:45,483 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:54:45,483 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:45,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:45,483 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:45,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:45,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:45,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:45,583 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:54:45,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:54:45,588 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:54:45,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-13 17:54:45,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:45,589 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 17:54:45,589 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:45,589 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-13 17:54:45,589 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-13 17:54:45,590 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:45,590 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:45,592 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:45,592 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:45,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:45,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:45,593 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:45,593 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:54:45,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:45,593 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:45,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:54:45,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:45,593 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:45,594 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-13 17:54:45,594 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:45,594 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-13 17:54:45,594 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:45,594 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-13 17:54:45,594 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:54:45,594 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:54:45,594 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9. 2023-02-13 17:54:45,594 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9. started... 2023-02-13 17:54:45,594 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c963ca8c1a0836a4d54901641d03d8f9 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 17:54:46,007 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601017c614096837e492999c7990c207ff4fd to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601017c614096837e492999c7990c207ff4fd 2023-02-13 17:54:46,413 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/.tmp/family1/763021c5fe3449a4932e6caa7261b4d8 2023-02-13 17:54:46,418 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/.tmp/family1/763021c5fe3449a4932e6caa7261b4d8 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/763021c5fe3449a4932e6caa7261b4d8 2023-02-13 17:54:46,422 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/763021c5fe3449a4932e6caa7261b4d8, entries=1, sequenceid=29, filesize=5.0 K 2023-02-13 17:54:46,423 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c963ca8c1a0836a4d54901641d03d8f9 in 829ms, sequenceid=29, compaction requested=true 2023-02-13 17:54:46,423 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c963ca8c1a0836a4d54901641d03d8f9: 2023-02-13 17:54:46,423 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9. 2023-02-13 17:54:46,423 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:54:46,423 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:54:46,423 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:46,423 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-13 17:54:46,423 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-13 17:54:46,425 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:46,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:46,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:46,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:46,425 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:46,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:46,426 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:46,426 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:54:46,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:46,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:46,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:46,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:46,427 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-13 17:54:46,427 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5daf93f0[Count = 0] remaining members to acquire global barrier 2023-02-13 17:54:46,427 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-13 17:54:46,428 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:46,429 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:46,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:46,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:46,429 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-13 17:54:46,429 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-13 17:54:46,429 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:54:46,429 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:46,429 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:54:46,430 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-13 17:54:46,430 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:46,430 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:46,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:46,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:46,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:46,430 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-13 17:54:46,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:46,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:46,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:46,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:46,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:46,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:46,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:46,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:54:46,434 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-13 17:54:46,434 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-13 17:54:46,434 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:54:46,434 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:54:46,434 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:46,434 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:54:46,438 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:46,439 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:46,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:46,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:46,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:46,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:46,439 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:46,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:46,439 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:46,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:46,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:46,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:46,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:46,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:46,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:46,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:46,440 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:46,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:46,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:46,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:46,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:46,442 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:46,442 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:46,442 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:46,442 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:46,442 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:46,442 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:46,442 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:46,442 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 17:54:46,442 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:54:46,442 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:46,442 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:46,442 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:46,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:46,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:46,443 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-13 17:54:46,443 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:54:46,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:46,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:46,543 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:54:46,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:54:46,548 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:54:46,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-13 17:54:46,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:46,549 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 17:54:46,549 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:46,549 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-13 17:54:46,549 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-13 17:54:46,550 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:46,550 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:46,551 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:46,551 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:46,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:46,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:46,551 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:46,551 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:54:46,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:46,552 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:46,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:54:46,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:46,552 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:46,552 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-13 17:54:46,552 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:46,552 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-13 17:54:46,552 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:46,552 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-13 17:54:46,552 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:54:46,552 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:54:46,552 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9. 2023-02-13 17:54:46,553 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9. started... 2023-02-13 17:54:46,553 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c963ca8c1a0836a4d54901641d03d8f9 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 17:54:46,968 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601032fa39f245854484889cd5286311f59ff to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601032fa39f245854484889cd5286311f59ff 2023-02-13 17:54:47,374 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/.tmp/family1/9395092dde7e4129ad91627c9cb8c0e0 2023-02-13 17:54:47,380 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/.tmp/family1/9395092dde7e4129ad91627c9cb8c0e0 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/9395092dde7e4129ad91627c9cb8c0e0 2023-02-13 17:54:47,384 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/9395092dde7e4129ad91627c9cb8c0e0, entries=1, sequenceid=33, filesize=5.0 K 2023-02-13 17:54:47,385 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c963ca8c1a0836a4d54901641d03d8f9 in 832ms, sequenceid=33, compaction requested=true 2023-02-13 17:54:47,386 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c963ca8c1a0836a4d54901641d03d8f9: 2023-02-13 17:54:47,386 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9. 2023-02-13 17:54:47,386 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:54:47,386 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:54:47,386 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:47,386 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-13 17:54:47,386 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-13 17:54:47,389 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:47,389 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:47,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:47,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:47,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:47,389 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:47,390 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:54:47,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:47,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:47,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:47,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:47,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:47,392 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-13 17:54:47,392 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f0e20e3[Count = 0] remaining members to acquire global barrier 2023-02-13 17:54:47,392 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-13 17:54:47,392 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:47,394 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:47,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:47,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:47,394 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-13 17:54:47,394 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-13 17:54:47,394 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:54:47,394 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:47,394 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:54:47,395 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:47,395 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-13 17:54:47,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:47,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:47,395 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:47,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:47,396 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-13 17:54:47,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:47,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:47,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:47,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:47,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:47,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:47,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:47,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:54:47,399 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-13 17:54:47,399 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-13 17:54:47,399 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:54:47,399 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:54:47,399 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:47,399 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:54:47,401 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:47,401 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:47,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:47,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:47,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:47,401 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:47,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:47,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:47,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:47,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:47,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:47,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:47,402 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:47,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:47,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:47,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:47,403 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:47,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:47,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:47,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:47,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:47,409 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:47,409 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:47,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:47,409 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 17:54:47,409 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:54:47,409 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:47,409 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:47,409 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:47,409 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:47,409 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-13 17:54:47,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:47,409 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-13 17:54:47,409 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:54:47,409 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:47,409 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:47,409 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:47,409 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:47,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:47,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:47,509 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:54:47,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:54:47,515 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:54:47,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-13 17:54:47,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:47,517 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 17:54:47,517 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:47,517 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-13 17:54:47,517 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-13 17:54:47,517 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:47,517 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:47,518 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:47,519 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:47,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:47,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:47,519 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:47,519 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:54:47,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:47,520 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:47,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:54:47,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:47,520 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:47,520 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-13 17:54:47,521 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:47,521 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-13 17:54:47,521 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:47,521 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-13 17:54:47,521 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:54:47,521 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:54:47,521 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9. 2023-02-13 17:54:47,521 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9. started... 2023-02-13 17:54:47,521 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c963ca8c1a0836a4d54901641d03d8f9 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 17:54:47,936 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509070e206891477747f4b2173254a99114fc to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201509070e206891477747f4b2173254a99114fc 2023-02-13 17:54:48,341 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/.tmp/family1/e789cbfaa4324450983dad42822fa22f 2023-02-13 17:54:48,345 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/.tmp/family1/e789cbfaa4324450983dad42822fa22f as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/e789cbfaa4324450983dad42822fa22f 2023-02-13 17:54:48,349 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/e789cbfaa4324450983dad42822fa22f, entries=1, sequenceid=37, filesize=5.0 K 2023-02-13 17:54:48,350 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c963ca8c1a0836a4d54901641d03d8f9 in 829ms, sequenceid=37, compaction requested=true 2023-02-13 17:54:48,350 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c963ca8c1a0836a4d54901641d03d8f9: 2023-02-13 17:54:48,350 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9. 2023-02-13 17:54:48,350 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:54:48,350 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:54:48,350 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:48,350 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-13 17:54:48,350 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-13 17:54:48,352 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:48,352 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:48,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:48,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:48,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:48,352 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:48,352 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:54:48,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:48,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:48,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:48,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:48,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:48,353 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-13 17:54:48,353 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@301f8520[Count = 0] remaining members to acquire global barrier 2023-02-13 17:54:48,353 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-13 17:54:48,353 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:48,354 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:48,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:48,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:48,355 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-13 17:54:48,355 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-13 17:54:48,355 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:54:48,355 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:48,355 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:54:48,357 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:48,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:48,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:48,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:48,357 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-13 17:54:48,357 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:48,357 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-13 17:54:48,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:48,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:48,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:48,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:48,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:48,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:48,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:48,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:54:48,359 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-13 17:54:48,359 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-13 17:54:48,359 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:54:48,359 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:54:48,359 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:48,359 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:54:48,361 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:48,361 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:48,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:48,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:48,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:48,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:48,361 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:48,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:48,361 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:48,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:48,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:48,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:48,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:48,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:48,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:48,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:48,362 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:48,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:48,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:48,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:48,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:48,368 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:48,368 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:48,368 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:48,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:48,368 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:48,368 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:48,368 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:48,368 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 17:54:48,368 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:54:48,368 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:48,368 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-13 17:54:48,368 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:48,368 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:48,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:48,369 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-13 17:54:48,369 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:48,369 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:54:48,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:48,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:48,469 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:54:48,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:54:48,474 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:54:48,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-13 17:54:48,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:48,475 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 17:54:48,476 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:48,476 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-13 17:54:48,476 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-13 17:54:48,476 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:48,476 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:48,477 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:48,477 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:48,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:48,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:48,477 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:48,477 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:54:48,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:48,478 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:48,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:54:48,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:48,478 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:48,480 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-13 17:54:48,480 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:48,480 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-13 17:54:48,480 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:48,480 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-13 17:54:48,480 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:54:48,480 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:54:48,480 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9. 2023-02-13 17:54:48,480 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9. started... 2023-02-13 17:54:48,480 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c963ca8c1a0836a4d54901641d03d8f9 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 17:54:48,496 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112045bbc1481af647b4b9b540aafe32044f to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112045bbc1481af647b4b9b540aafe32044f 2023-02-13 17:54:48,910 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/.tmp/family1/0ce4cc56a7f54d4dbccdfb9990c305f7 2023-02-13 17:54:48,914 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/.tmp/family1/0ce4cc56a7f54d4dbccdfb9990c305f7 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/0ce4cc56a7f54d4dbccdfb9990c305f7 2023-02-13 17:54:48,918 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/0ce4cc56a7f54d4dbccdfb9990c305f7, entries=1, sequenceid=41, filesize=5.0 K 2023-02-13 17:54:48,919 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c963ca8c1a0836a4d54901641d03d8f9 in 438ms, sequenceid=41, compaction requested=true 2023-02-13 17:54:48,919 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c963ca8c1a0836a4d54901641d03d8f9: 2023-02-13 17:54:48,919 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9. 2023-02-13 17:54:48,919 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:54:48,919 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:54:48,919 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:48,919 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-13 17:54:48,919 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-13 17:54:48,920 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:48,920 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:48,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:48,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:48,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:48,921 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:48,921 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:54:48,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:48,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:48,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:48,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:48,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:48,922 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-13 17:54:48,922 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@725fe211[Count = 0] remaining members to acquire global barrier 2023-02-13 17:54:48,922 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-13 17:54:48,922 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:48,923 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:48,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:48,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:48,923 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-13 17:54:48,923 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-13 17:54:48,923 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:54:48,923 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:48,923 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:54:48,924 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:48,924 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-13 17:54:48,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:48,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:48,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:48,925 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:48,925 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-13 17:54:48,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:48,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:48,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:48,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:48,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:48,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:48,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:48,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:54:48,927 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-13 17:54:48,927 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-13 17:54:48,927 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:54:48,927 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:54:48,927 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:48,927 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:54:48,929 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:48,929 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:48,929 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:48,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:48,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:48,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:48,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:48,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:48,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:48,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:48,929 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:48,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:48,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:48,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:48,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:48,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:48,930 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:48,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:48,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:48,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:48,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:48,932 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:48,932 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:48,932 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:48,932 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:48,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:48,932 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 17:54:48,933 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:54:48,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:48,932 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:48,932 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:48,933 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:48,933 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:48,933 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-13 17:54:48,933 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-13 17:54:48,933 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:54:48,933 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:48,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:48,933 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:48,933 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:49,033 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:54:49,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:54:49,035 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41433] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:49,036 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-13 17:54:49,037 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-13 17:54:49,038 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 17:54:49,038 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=42, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676311489038 2023-02-13 17:54:49,041 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-13 17:54:49,042 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-02-13 17:54:49,042 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-13 17:54:49,042 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] zookeeper.ReadOnlyZKClient(139): Connect 0x76938106 to 127.0.0.1:64825 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 17:54:49,046 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@47d551a1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 17:54:49,046 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 17:54:49,882 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103c7d70d6a3f2549b39a15c373cc7ca59a to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103c7d70d6a3f2549b39a15c373cc7ca59a 2023-02-13 17:54:49,883 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-13 17:54:49,895 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 17:54:49,896 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47672, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 17:54:49,902 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 17:54:49,904 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47042, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 17:54:49,912 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/5b2567838821456a891d6d78762b8111 first=Optional[r3] last=Optional[r6] 2023-02-13 17:54:49,912 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9., hostname=jenkins-hbase4.apache.org,38881,1676310818035, seqNum=2 for row with hfile group [{family1,hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/5b2567838821456a891d6d78762b8111}] 2023-02-13 17:54:49,916 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(763): Validating hfile at hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/5b2567838821456a891d6d78762b8111 for inclusion in c963ca8c1a0836a4d54901641d03d8f9/family1 2023-02-13 17:54:49,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-13 17:54:49,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 17:54:49,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegion(2445): Flush status journal for c963ca8c1a0836a4d54901641d03d8f9: 2023-02-13 17:54:49,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/5b2567838821456a891d6d78762b8111 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ktn1gam0lol1lbehv7i1jcjm2566obv2aut9bvsd8o284t2dfns8jnmmjk5lbrn7/family1/5b2567838821456a891d6d78762b8111 2023-02-13 17:54:49,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ktn1gam0lol1lbehv7i1jcjm2566obv2aut9bvsd8o284t2dfns8jnmmjk5lbrn7/family1/5b2567838821456a891d6d78762b8111 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/b2f5ce3182c648a18921b5241b1a4334_SeqId_44_ 2023-02-13 17:54:49,922 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(849): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ktn1gam0lol1lbehv7i1jcjm2566obv2aut9bvsd8o284t2dfns8jnmmjk5lbrn7/family1/5b2567838821456a891d6d78762b8111 into c963ca8c1a0836a4d54901641d03d8f9/family1 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/b2f5ce3182c648a18921b5241b1a4334_SeqId_44_ - updating store file list. 2023-02-13 17:54:49,925 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(882): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/b2f5ce3182c648a18921b5241b1a4334_SeqId_44_ into c963ca8c1a0836a4d54901641d03d8f9/family1 2023-02-13 17:54:49,925 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(855): Successfully loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ktn1gam0lol1lbehv7i1jcjm2566obv2aut9bvsd8o284t2dfns8jnmmjk5lbrn7/family1/5b2567838821456a891d6d78762b8111 into c963ca8c1a0836a4d54901641d03d8f9/family1 (new location: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/b2f5ce3182c648a18921b5241b1a4334_SeqId_44_) 2023-02-13 17:54:49,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ktn1gam0lol1lbehv7i1jcjm2566obv2aut9bvsd8o284t2dfns8jnmmjk5lbrn7/family1/5b2567838821456a891d6d78762b8111 2023-02-13 17:54:49,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-13 17:54:49,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51565 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-13 17:54:49,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(1912): c963ca8c1a0836a4d54901641d03d8f9/family1 is initiating minor compaction 2023-02-13 17:54:49,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7faf181f; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 17:54:49,929 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of c963ca8c1a0836a4d54901641d03d8f9/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9. 2023-02-13 17:54:49,929 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/b9117707c2a84816aae39a40a3b92815, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/88c491803b064e86acec7ad0b77647c9, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/f137b48d94284670af62a0934d9b90e5, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/fe67945711c84be8a90513879d796e79, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/78a813f90254432a82bee4db317ed153, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/763021c5fe3449a4932e6caa7261b4d8, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/9395092dde7e4129ad91627c9cb8c0e0, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/e789cbfaa4324450983dad42822fa22f, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/0ce4cc56a7f54d4dbccdfb9990c305f7, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/b2f5ce3182c648a18921b5241b1a4334_SeqId_44_] into tmpdir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/.tmp, totalSize=50.4 K 2023-02-13 17:54:49,929 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting b9117707c2a84816aae39a40a3b92815, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-13 17:54:49,929 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting 88c491803b064e86acec7ad0b77647c9, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-13 17:54:49,929 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting f137b48d94284670af62a0934d9b90e5, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-13 17:54:49,929 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting fe67945711c84be8a90513879d796e79, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-13 17:54:49,929 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting 78a813f90254432a82bee4db317ed153, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-13 17:54:49,929 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting 763021c5fe3449a4932e6caa7261b4d8, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-13 17:54:49,929 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting 9395092dde7e4129ad91627c9cb8c0e0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-13 17:54:49,929 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting e789cbfaa4324450983dad42822fa22f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-13 17:54:49,929 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting 0ce4cc56a7f54d4dbccdfb9990c305f7, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-13 17:54:49,929 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting b2f5ce3182c648a18921b5241b1a4334_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-13 17:54:49,930 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-13 17:54:49,931 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:54:49,933 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512284f5ade47bb0946b889107ad798a62410 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512284f5ade47bb0946b889107ad798a62410 2023-02-13 17:54:49,935 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512314de16ae2f68d46d599d6c49435001ac6 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512314de16ae2f68d46d599d6c49435001ac6 2023-02-13 17:54:49,936 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601017c614096837e492999c7990c207ff4fd to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601017c614096837e492999c7990c207ff4fd 2023-02-13 17:54:49,937 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601032fa39f245854484889cd5286311f59ff to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601032fa39f245854484889cd5286311f59ff 2023-02-13 17:54:49,937 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4 expired mob files are deleted 2023-02-13 17:54:49,937 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-13 17:54:49,938 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 17:54:49,938 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 17:54:49,938 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 17:54:49,938 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 17:54:49,938 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 17:54:49,938 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 17:54:49,938 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 17:54:49,938 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 17:54:49,958 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] throttle.PressureAwareThroughputController(145): c963ca8c1a0836a4d54901641d03d8f9#family1#compaction#61 average throughput is 0.79 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 17:54:50,390 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205ab7142f1ef5644e79c4cca8bab75ce5b to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205ab7142f1ef5644e79c4cca8bab75ce5b 2023-02-13 17:54:50,391 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-13 17:54:50,413 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/fbc4d7c7adf34c49be77325910462800 first=Optional[r00] last=Optional[r2] 2023-02-13 17:54:50,414 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9., hostname=jenkins-hbase4.apache.org,38881,1676310818035, seqNum=2 for row with hfile group [{family1,hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/fbc4d7c7adf34c49be77325910462800}] 2023-02-13 17:54:50,416 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(763): Validating hfile at hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/fbc4d7c7adf34c49be77325910462800 for inclusion in c963ca8c1a0836a4d54901641d03d8f9/family1 2023-02-13 17:54:50,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-02-13 17:54:50,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 17:54:50,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegion(2445): Flush status journal for c963ca8c1a0836a4d54901641d03d8f9: 2023-02-13 17:54:50,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/fbc4d7c7adf34c49be77325910462800 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__29e3rgj7jtganum8bbuopon721e4rggsmji9lbph7htfiovq82if7te8sg2d0f0m/family1/fbc4d7c7adf34c49be77325910462800 2023-02-13 17:54:50,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__29e3rgj7jtganum8bbuopon721e4rggsmji9lbph7htfiovq82if7te8sg2d0f0m/family1/fbc4d7c7adf34c49be77325910462800 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/22a338a79dbf4776a9f95b2b565008ed_SeqId_46_ 2023-02-13 17:54:50,421 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(849): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__29e3rgj7jtganum8bbuopon721e4rggsmji9lbph7htfiovq82if7te8sg2d0f0m/family1/fbc4d7c7adf34c49be77325910462800 into c963ca8c1a0836a4d54901641d03d8f9/family1 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/22a338a79dbf4776a9f95b2b565008ed_SeqId_46_ - updating store file list. 2023-02-13 17:54:50,424 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(882): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/22a338a79dbf4776a9f95b2b565008ed_SeqId_46_ into c963ca8c1a0836a4d54901641d03d8f9/family1 2023-02-13 17:54:50,424 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(855): Successfully loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__29e3rgj7jtganum8bbuopon721e4rggsmji9lbph7htfiovq82if7te8sg2d0f0m/family1/fbc4d7c7adf34c49be77325910462800 into c963ca8c1a0836a4d54901641d03d8f9/family1 (new location: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/22a338a79dbf4776a9f95b2b565008ed_SeqId_46_) 2023-02-13 17:54:50,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__29e3rgj7jtganum8bbuopon721e4rggsmji9lbph7htfiovq82if7te8sg2d0f0m/family1/fbc4d7c7adf34c49be77325910462800 2023-02-13 17:54:50,426 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-13 17:54:50,427 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:54:50,428 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130bb87e4b52a284d82a4312c63036eb2d9 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130bb87e4b52a284d82a4312c63036eb2d9 2023-02-13 17:54:50,429 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201c9e97fe8334a4e05aac15b588f331592 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201c9e97fe8334a4e05aac15b588f331592 2023-02-13 17:54:50,430 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205fe87b3b6d0564cf7994c9a1b0195f12f to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205fe87b3b6d0564cf7994c9a1b0195f12f 2023-02-13 17:54:50,431 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 3 expired mob files are deleted 2023-02-13 17:54:50,431 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-13 17:54:50,431 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 17:54:50,431 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-13 17:54:50,431 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 17:54:50,432 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=42, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-13 17:54:50,434 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 1.3960 sec 2023-02-13 17:54:50,517 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.HMaster$12(2441): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-13 17:54:50,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure2.ProcedureExecutor(1029): Stored pid=43, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:50,773 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/.tmp/family1/882b2a51758640259fbc99422cdf6a2c as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/882b2a51758640259fbc99422cdf6a2c 2023-02-13 17:54:50,778 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in c963ca8c1a0836a4d54901641d03d8f9/family1 of c963ca8c1a0836a4d54901641d03d8f9 into 882b2a51758640259fbc99422cdf6a2c(size=6.8 K), total size for store is 390.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 17:54:50,778 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for c963ca8c1a0836a4d54901641d03d8f9: 2023-02-13 17:54:50,779 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9., storeName=family1, fileCount=10, fileSize=50.4 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1676310889928; duration=0sec 2023-02-13 17:54:50,779 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 17:54:50,866 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/b9117707c2a84816aae39a40a3b92815, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/88c491803b064e86acec7ad0b77647c9, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/f137b48d94284670af62a0934d9b90e5, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/fe67945711c84be8a90513879d796e79, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/78a813f90254432a82bee4db317ed153, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/763021c5fe3449a4932e6caa7261b4d8, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/9395092dde7e4129ad91627c9cb8c0e0, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/e789cbfaa4324450983dad42822fa22f, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/0ce4cc56a7f54d4dbccdfb9990c305f7, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/b2f5ce3182c648a18921b5241b1a4334_SeqId_44_] to archive 2023-02-13 17:54:50,867 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:54:50,868 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/b9117707c2a84816aae39a40a3b92815 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/b9117707c2a84816aae39a40a3b92815 2023-02-13 17:54:50,870 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/88c491803b064e86acec7ad0b77647c9 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/88c491803b064e86acec7ad0b77647c9 2023-02-13 17:54:50,871 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/f137b48d94284670af62a0934d9b90e5 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/f137b48d94284670af62a0934d9b90e5 2023-02-13 17:54:50,872 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/fe67945711c84be8a90513879d796e79 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/fe67945711c84be8a90513879d796e79 2023-02-13 17:54:50,873 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/78a813f90254432a82bee4db317ed153 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/78a813f90254432a82bee4db317ed153 2023-02-13 17:54:50,875 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/763021c5fe3449a4932e6caa7261b4d8 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/763021c5fe3449a4932e6caa7261b4d8 2023-02-13 17:54:50,876 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/9395092dde7e4129ad91627c9cb8c0e0 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/9395092dde7e4129ad91627c9cb8c0e0 2023-02-13 17:54:50,877 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/e789cbfaa4324450983dad42822fa22f to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/e789cbfaa4324450983dad42822fa22f 2023-02-13 17:54:50,878 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/0ce4cc56a7f54d4dbccdfb9990c305f7 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/0ce4cc56a7f54d4dbccdfb9990c305f7 2023-02-13 17:54:50,879 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/b2f5ce3182c648a18921b5241b1a4334_SeqId_44_ to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/b2f5ce3182c648a18921b5241b1a4334_SeqId_44_ 2023-02-13 17:54:50,926 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-02-13 17:54:50,927 DEBUG [PEWorker-4] util.FSTableDescriptors(519): Deleted hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-02-13 17:54:50,927 INFO [PEWorker-4] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-02-13 17:54:50,929 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-02-13 17:54:50,932 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=c963ca8c1a0836a4d54901641d03d8f9, REOPEN/MOVE}] 2023-02-13 17:54:50,932 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=c963ca8c1a0836a4d54901641d03d8f9, REOPEN/MOVE 2023-02-13 17:54:50,933 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=c963ca8c1a0836a4d54901641d03d8f9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:50,933 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676310890933"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676310890933"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676310890933"}]},"ts":"1676310890933"} 2023-02-13 17:54:50,934 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=45, state=RUNNABLE; CloseRegionProcedure c963ca8c1a0836a4d54901641d03d8f9, server=jenkins-hbase4.apache.org,38881,1676310818035}] 2023-02-13 17:54:51,086 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close c963ca8c1a0836a4d54901641d03d8f9 2023-02-13 17:54:51,086 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c963ca8c1a0836a4d54901641d03d8f9, disabling compactions & flushes 2023-02-13 17:54:51,086 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9. 2023-02-13 17:54:51,086 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9. 2023-02-13 17:54:51,086 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9. after waiting 0 ms 2023-02-13 17:54:51,086 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9. 2023-02-13 17:54:51,090 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/recovered.edits/49.seqid, newMaxSeqId=49, maxSeqId=1 2023-02-13 17:54:51,091 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9. 2023-02-13 17:54:51,091 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c963ca8c1a0836a4d54901641d03d8f9: Waiting for close lock at 1676310891086Running coprocessor pre-close hooks at 1676310891086Disabling compacts and flushes for region at 1676310891086Disabling writes for close at 1676310891086Writing region close event to WAL at 1676310891087 (+1 ms)Running coprocessor post-close hooks at 1676310891091 (+4 ms)Closed at 1676310891091 2023-02-13 17:54:51,092 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: c963ca8c1a0836a4d54901641d03d8f9 to self. 2023-02-13 17:54:51,093 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed c963ca8c1a0836a4d54901641d03d8f9 2023-02-13 17:54:51,093 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=c963ca8c1a0836a4d54901641d03d8f9, regionState=CLOSED 2023-02-13 17:54:51,093 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676310891093"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676310891093"}]},"ts":"1676310891093"} 2023-02-13 17:54:51,096 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=45 2023-02-13 17:54:51,096 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=45, state=SUCCESS; CloseRegionProcedure c963ca8c1a0836a4d54901641d03d8f9, server=jenkins-hbase4.apache.org,38881,1676310818035 in 160 msec 2023-02-13 17:54:51,096 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=c963ca8c1a0836a4d54901641d03d8f9, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,38881,1676310818035; forceNewPlan=false, retain=true 2023-02-13 17:54:51,247 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=c963ca8c1a0836a4d54901641d03d8f9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:51,247 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676310891247"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676310891247"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676310891247"}]},"ts":"1676310891247"} 2023-02-13 17:54:51,248 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=45, state=RUNNABLE; OpenRegionProcedure c963ca8c1a0836a4d54901641d03d8f9, server=jenkins-hbase4.apache.org,38881,1676310818035}] 2023-02-13 17:54:51,402 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9. 2023-02-13 17:54:51,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c963ca8c1a0836a4d54901641d03d8f9, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9.', STARTKEY => '', ENDKEY => ''} 2023-02-13 17:54:51,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly c963ca8c1a0836a4d54901641d03d8f9 2023-02-13 17:54:51,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 17:54:51,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c963ca8c1a0836a4d54901641d03d8f9 2023-02-13 17:54:51,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c963ca8c1a0836a4d54901641d03d8f9 2023-02-13 17:54:51,404 INFO [StoreOpener-c963ca8c1a0836a4d54901641d03d8f9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c963ca8c1a0836a4d54901641d03d8f9 2023-02-13 17:54:51,405 DEBUG [StoreOpener-c963ca8c1a0836a4d54901641d03d8f9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1 2023-02-13 17:54:51,405 DEBUG [StoreOpener-c963ca8c1a0836a4d54901641d03d8f9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1 2023-02-13 17:54:51,405 INFO [StoreOpener-c963ca8c1a0836a4d54901641d03d8f9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c963ca8c1a0836a4d54901641d03d8f9 columnFamilyName family1 2023-02-13 17:54:51,410 DEBUG [StoreOpener-c963ca8c1a0836a4d54901641d03d8f9-1] regionserver.HStore(539): loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/1147bc42a5384d8785a7ed9fb0544657 2023-02-13 17:54:51,414 DEBUG [StoreOpener-c963ca8c1a0836a4d54901641d03d8f9-1] regionserver.HStore(539): loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/22a338a79dbf4776a9f95b2b565008ed_SeqId_46_ 2023-02-13 17:54:51,417 DEBUG [StoreOpener-c963ca8c1a0836a4d54901641d03d8f9-1] regionserver.HStore(539): loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/882b2a51758640259fbc99422cdf6a2c 2023-02-13 17:54:51,417 INFO [StoreOpener-c963ca8c1a0836a4d54901641d03d8f9-1] regionserver.HStore(310): Store=c963ca8c1a0836a4d54901641d03d8f9/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 17:54:51,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9 2023-02-13 17:54:51,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9 2023-02-13 17:54:51,422 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c963ca8c1a0836a4d54901641d03d8f9 2023-02-13 17:54:51,422 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c963ca8c1a0836a4d54901641d03d8f9; next sequenceid=50; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70695358, jitterRate=0.053442925214767456}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 17:54:51,422 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c963ca8c1a0836a4d54901641d03d8f9: Running coprocessor pre-open hook at 1676310891403Writing region info on filesystem at 1676310891403Initializing all the Stores at 1676310891404 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1676310891404Cleaning up temporary data from old regions at 1676310891419 (+15 ms)Cleaning up detritus from prior splits at 1676310891420 (+1 ms)Running coprocessor post-open hooks at 1676310891422 (+2 ms)Region opened successfully at 1676310891422 2023-02-13 17:54:51,423 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9., pid=47, masterSystemTime=1676310891400 2023-02-13 17:54:51,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 17:54:51,424 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-13 17:54:51,425 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 399433 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-13 17:54:51,425 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HStore(1912): c963ca8c1a0836a4d54901641d03d8f9/family1 is initiating minor compaction (all files) 2023-02-13 17:54:51,425 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of c963ca8c1a0836a4d54901641d03d8f9/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9. 2023-02-13 17:54:51,425 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9. 2023-02-13 17:54:51,425 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/1147bc42a5384d8785a7ed9fb0544657, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/882b2a51758640259fbc99422cdf6a2c, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/22a338a79dbf4776a9f95b2b565008ed_SeqId_46_] into tmpdir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/.tmp, totalSize=390.1 K 2023-02-13 17:54:51,425 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9. 2023-02-13 17:54:51,426 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=c963ca8c1a0836a4d54901641d03d8f9, regionState=OPEN, openSeqNum=50, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:51,426 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676310891426"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676310891426"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676310891426"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676310891426"}]},"ts":"1676310891426"} 2023-02-13 17:54:51,426 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting 1147bc42a5384d8785a7ed9fb0544657, keycount=1000, bloomtype=ROW, size=191.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878841551 2023-02-13 17:54:51,426 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting 882b2a51758640259fbc99422cdf6a2c, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621241551 2023-02-13 17:54:51,427 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting 22a338a79dbf4776a9f95b2b565008ed_SeqId_46_, keycount=1002, bloomtype=ROW, size=191.8 K, encoding=NONE, compression=NONE, seqNum=47, earliestPutTs=1448878841551 2023-02-13 17:54:51,429 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=45 2023-02-13 17:54:51,429 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=45, state=SUCCESS; OpenRegionProcedure c963ca8c1a0836a4d54901641d03d8f9, server=jenkins-hbase4.apache.org,38881,1676310818035 in 179 msec 2023-02-13 17:54:51,430 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-02-13 17:54:51,430 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=c963ca8c1a0836a4d54901641d03d8f9, REOPEN/MOVE in 498 msec 2023-02-13 17:54:51,432 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=43 2023-02-13 17:54:51,432 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=43, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 502 msec 2023-02-13 17:54:51,434 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=43, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 915 msec 2023-02-13 17:54:51,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=43 2023-02-13 17:54:51,436 INFO [Listener at localhost/35343] compactions.TestMobCompactor(278): alter status finished 2023-02-13 17:54:51,437 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41433] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:51,438 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-13 17:54:51,439 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-13 17:54:51,439 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 17:54:51,439 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676311491439 2023-02-13 17:54:51,442 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] throttle.PressureAwareThroughputController(145): c963ca8c1a0836a4d54901641d03d8f9#family1#compaction#62 average throughput is 20.07 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 17:54:51,442 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-13 17:54:51,442 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-02-13 17:54:51,442 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-13 17:54:51,443 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] zookeeper.ReadOnlyZKClient(139): Connect 0x2aef95a4 to 127.0.0.1:64825 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 17:54:51,447 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@47da9101, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 17:54:51,447 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 17:54:51,447 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 17:54:51,447 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 17:54:51,447 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 17:54:51,447 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 17:54:52,272 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112870670adf16dd4c6db8c436a6d323da95 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112870670adf16dd4c6db8c436a6d323da95 2023-02-13 17:54:52,273 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-13 17:54:52,286 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 17:54:52,287 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47682, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 17:54:52,293 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 17:54:52,295 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47050, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 17:54:52,303 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/b0521b7268de43939791ad4331f9f4b6 first=Optional[r05] last=Optional[r8] 2023-02-13 17:54:52,304 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9., hostname=jenkins-hbase4.apache.org,38881,1676310818035, seqNum=50 for row with hfile group [{family1,hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/b0521b7268de43939791ad4331f9f4b6}] 2023-02-13 17:54:52,308 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(763): Validating hfile at hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/b0521b7268de43939791ad4331f9f4b6 for inclusion in c963ca8c1a0836a4d54901641d03d8f9/family1 2023-02-13 17:54:52,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-02-13 17:54:52,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 17:54:52,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegion(2445): Flush status journal for c963ca8c1a0836a4d54901641d03d8f9: 2023-02-13 17:54:52,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/b0521b7268de43939791ad4331f9f4b6 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__7h1g2kf36k99icnlh975qg27krut3og3u36mt6agubr0leto7r098isfl70nijst/family1/b0521b7268de43939791ad4331f9f4b6 2023-02-13 17:54:52,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__7h1g2kf36k99icnlh975qg27krut3og3u36mt6agubr0leto7r098isfl70nijst/family1/b0521b7268de43939791ad4331f9f4b6 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/bb00ef7e22cb445f8af4f160fceab30b_SeqId_52_ 2023-02-13 17:54:52,315 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(849): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__7h1g2kf36k99icnlh975qg27krut3og3u36mt6agubr0leto7r098isfl70nijst/family1/b0521b7268de43939791ad4331f9f4b6 into c963ca8c1a0836a4d54901641d03d8f9/family1 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/bb00ef7e22cb445f8af4f160fceab30b_SeqId_52_ - updating store file list. 2023-02-13 17:54:52,318 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(882): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/bb00ef7e22cb445f8af4f160fceab30b_SeqId_52_ into c963ca8c1a0836a4d54901641d03d8f9/family1 2023-02-13 17:54:52,318 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(855): Successfully loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__7h1g2kf36k99icnlh975qg27krut3og3u36mt6agubr0leto7r098isfl70nijst/family1/b0521b7268de43939791ad4331f9f4b6 into c963ca8c1a0836a4d54901641d03d8f9/family1 (new location: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/bb00ef7e22cb445f8af4f160fceab30b_SeqId_52_) 2023-02-13 17:54:52,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__7h1g2kf36k99icnlh975qg27krut3og3u36mt6agubr0leto7r098isfl70nijst/family1/b0521b7268de43939791ad4331f9f4b6 2023-02-13 17:54:52,321 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-13 17:54:52,321 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:54:52,323 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112045bbc1481af647b4b9b540aafe32044f to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112045bbc1481af647b4b9b540aafe32044f 2023-02-13 17:54:52,324 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112844b9e479a3aa4151b1d9e5825da8ed00 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112844b9e479a3aa4151b1d9e5825da8ed00 2023-02-13 17:54:52,324 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2 expired mob files are deleted 2023-02-13 17:54:52,324 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-13 17:54:52,324 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 17:54:52,324 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 17:54:52,324 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 17:54:52,324 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-13 17:54:52,325 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 17:54:52,325 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-13 17:54:52,327 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 889 msec 2023-02-13 17:54:52,381 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.HMaster$12(2441): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-13 17:54:52,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:52,660 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/.tmp/family1/c5530b90ed954f13a449e9c8bad86400 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/c5530b90ed954f13a449e9c8bad86400 2023-02-13 17:54:52,664 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in c963ca8c1a0836a4d54901641d03d8f9/family1 of c963ca8c1a0836a4d54901641d03d8f9 into c5530b90ed954f13a449e9c8bad86400(size=193.0 K), total size for store is 198.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 17:54:52,664 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for c963ca8c1a0836a4d54901641d03d8f9: 2023-02-13 17:54:52,664 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9., storeName=c963ca8c1a0836a4d54901641d03d8f9/family1, priority=13, startTime=1676310891423; duration=1sec 2023-02-13 17:54:52,664 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 17:54:52,759 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/1147bc42a5384d8785a7ed9fb0544657, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/882b2a51758640259fbc99422cdf6a2c, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/22a338a79dbf4776a9f95b2b565008ed_SeqId_46_] to archive 2023-02-13 17:54:52,760 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:54:52,762 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/1147bc42a5384d8785a7ed9fb0544657 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/1147bc42a5384d8785a7ed9fb0544657 2023-02-13 17:54:52,763 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/882b2a51758640259fbc99422cdf6a2c to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/882b2a51758640259fbc99422cdf6a2c 2023-02-13 17:54:52,764 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/22a338a79dbf4776a9f95b2b565008ed_SeqId_46_ to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/22a338a79dbf4776a9f95b2b565008ed_SeqId_46_ 2023-02-13 17:54:52,790 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-02-13 17:54:52,791 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-02-13 17:54:52,791 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-02-13 17:54:52,793 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=49, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-02-13 17:54:52,796 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=c963ca8c1a0836a4d54901641d03d8f9, REOPEN/MOVE}] 2023-02-13 17:54:52,796 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=c963ca8c1a0836a4d54901641d03d8f9, REOPEN/MOVE 2023-02-13 17:54:52,797 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=c963ca8c1a0836a4d54901641d03d8f9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:52,797 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676310892797"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676310892797"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676310892797"}]},"ts":"1676310892797"} 2023-02-13 17:54:52,799 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE; CloseRegionProcedure c963ca8c1a0836a4d54901641d03d8f9, server=jenkins-hbase4.apache.org,38881,1676310818035}] 2023-02-13 17:54:52,949 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close c963ca8c1a0836a4d54901641d03d8f9 2023-02-13 17:54:52,949 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c963ca8c1a0836a4d54901641d03d8f9, disabling compactions & flushes 2023-02-13 17:54:52,949 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9. 2023-02-13 17:54:52,949 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9. 2023-02-13 17:54:52,949 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9. after waiting 0 ms 2023-02-13 17:54:52,949 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9. 2023-02-13 17:54:52,955 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=49 2023-02-13 17:54:52,955 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9. 2023-02-13 17:54:52,956 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c963ca8c1a0836a4d54901641d03d8f9: Waiting for close lock at 1676310892949Running coprocessor pre-close hooks at 1676310892949Disabling compacts and flushes for region at 1676310892949Disabling writes for close at 1676310892949Writing region close event to WAL at 1676310892952 (+3 ms)Running coprocessor post-close hooks at 1676310892955 (+3 ms)Closed at 1676310892955 2023-02-13 17:54:52,956 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: c963ca8c1a0836a4d54901641d03d8f9 to self. 2023-02-13 17:54:52,957 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed c963ca8c1a0836a4d54901641d03d8f9 2023-02-13 17:54:52,957 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=c963ca8c1a0836a4d54901641d03d8f9, regionState=CLOSED 2023-02-13 17:54:52,957 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676310892957"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676310892957"}]},"ts":"1676310892957"} 2023-02-13 17:54:52,959 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-02-13 17:54:52,959 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; CloseRegionProcedure c963ca8c1a0836a4d54901641d03d8f9, server=jenkins-hbase4.apache.org,38881,1676310818035 in 159 msec 2023-02-13 17:54:52,960 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=c963ca8c1a0836a4d54901641d03d8f9, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,38881,1676310818035; forceNewPlan=false, retain=true 2023-02-13 17:54:53,110 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=c963ca8c1a0836a4d54901641d03d8f9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:53,111 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676310893110"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676310893110"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676310893110"}]},"ts":"1676310893110"} 2023-02-13 17:54:53,112 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=51, state=RUNNABLE; OpenRegionProcedure c963ca8c1a0836a4d54901641d03d8f9, server=jenkins-hbase4.apache.org,38881,1676310818035}] 2023-02-13 17:54:53,266 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9. 2023-02-13 17:54:53,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c963ca8c1a0836a4d54901641d03d8f9, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9.', STARTKEY => '', ENDKEY => ''} 2023-02-13 17:54:53,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly c963ca8c1a0836a4d54901641d03d8f9 2023-02-13 17:54:53,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 17:54:53,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c963ca8c1a0836a4d54901641d03d8f9 2023-02-13 17:54:53,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c963ca8c1a0836a4d54901641d03d8f9 2023-02-13 17:54:53,268 INFO [StoreOpener-c963ca8c1a0836a4d54901641d03d8f9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c963ca8c1a0836a4d54901641d03d8f9 2023-02-13 17:54:53,269 DEBUG [StoreOpener-c963ca8c1a0836a4d54901641d03d8f9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1 2023-02-13 17:54:53,269 DEBUG [StoreOpener-c963ca8c1a0836a4d54901641d03d8f9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1 2023-02-13 17:54:53,269 INFO [StoreOpener-c963ca8c1a0836a4d54901641d03d8f9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c963ca8c1a0836a4d54901641d03d8f9 columnFamilyName family1 2023-02-13 17:54:53,274 DEBUG [StoreOpener-c963ca8c1a0836a4d54901641d03d8f9-1] regionserver.HStore(539): loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/bb00ef7e22cb445f8af4f160fceab30b_SeqId_52_ 2023-02-13 17:54:53,277 DEBUG [StoreOpener-c963ca8c1a0836a4d54901641d03d8f9-1] regionserver.HStore(539): loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/family1/c5530b90ed954f13a449e9c8bad86400 2023-02-13 17:54:53,277 INFO [StoreOpener-c963ca8c1a0836a4d54901641d03d8f9-1] regionserver.HStore(310): Store=c963ca8c1a0836a4d54901641d03d8f9/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 17:54:53,278 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9 2023-02-13 17:54:53,280 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9 2023-02-13 17:54:53,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c963ca8c1a0836a4d54901641d03d8f9 2023-02-13 17:54:53,283 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c963ca8c1a0836a4d54901641d03d8f9; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63941223, jitterRate=-0.047201529145240784}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 17:54:53,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c963ca8c1a0836a4d54901641d03d8f9: Running coprocessor pre-open hook at 1676310893267Writing region info on filesystem at 1676310893267Initializing all the Stores at 1676310893268 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1676310893268Cleaning up temporary data from old regions at 1676310893280 (+12 ms)Cleaning up detritus from prior splits at 1676310893281 (+1 ms)Running coprocessor post-open hooks at 1676310893283 (+2 ms)Region opened successfully at 1676310893283 2023-02-13 17:54:53,284 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9., pid=53, masterSystemTime=1676310893264 2023-02-13 17:54:53,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9. 2023-02-13 17:54:53,286 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9. 2023-02-13 17:54:53,286 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=c963ca8c1a0836a4d54901641d03d8f9, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:53,286 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676310893286"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676310893286"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676310893286"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676310893286"}]},"ts":"1676310893286"} 2023-02-13 17:54:53,289 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-02-13 17:54:53,289 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; OpenRegionProcedure c963ca8c1a0836a4d54901641d03d8f9, server=jenkins-hbase4.apache.org,38881,1676310818035 in 176 msec 2023-02-13 17:54:53,291 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=50 2023-02-13 17:54:53,291 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=50, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=c963ca8c1a0836a4d54901641d03d8f9, REOPEN/MOVE in 493 msec 2023-02-13 17:54:53,293 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=49 2023-02-13 17:54:53,293 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=49, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 498 msec 2023-02-13 17:54:53,295 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 913 msec 2023-02-13 17:54:53,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=49 2023-02-13 17:54:53,297 INFO [Listener at localhost/35343] compactions.TestMobCompactor(278): alter status finished 2023-02-13 17:54:53,298 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41433] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 17:54:53,299 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-13 17:54:53,300 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-13 17:54:53,300 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 17:54:53,300 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=54, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676311493300 2023-02-13 17:54:53,301 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-13 17:54:53,301 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-02-13 17:54:53,302 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-13 17:54:53,302 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] zookeeper.ReadOnlyZKClient(139): Connect 0x6f36c65b to 127.0.0.1:64825 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 17:54:53,306 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7cf71025, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 17:54:53,307 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 17:54:53,307 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 17:54:53,307 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 17:54:53,307 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 17:54:53,307 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 17:54:53,307 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 17:54:53,307 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 17:54:53,307 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 17:54:53,307 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-13 17:54:53,307 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 17:54:53,308 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=54, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-13 17:54:53,309 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 10 msec 2023-02-13 17:54:53,365 INFO [Listener at localhost/35343] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=249 (was 249), OpenFileDescriptor=622 (was 610) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=200 (was 247), ProcessCount=168 (was 168), AvailableMemoryMB=1053 (was 1150) 2023-02-13 17:54:53,376 INFO [Listener at localhost/35343] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=249, OpenFileDescriptor=622, MaxFileDescriptor=60000, SystemLoadAverage=200, ProcessCount=168, AvailableMemoryMB=1053 2023-02-13 17:54:53,378 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-13 17:54:53,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure2.ProcedureExecutor(1029): Stored pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:53,380 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 17:54:53,380 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily" procId is: 55 2023-02-13 17:54:53,381 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 17:54:53,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-13 17:54:53,382 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735 2023-02-13 17:54:53,382 DEBUG [HFileArchiver-10] backup.HFileArchiver(153): Directory hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735 empty. 2023-02-13 17:54:53,383 DEBUG [HFileArchiver-10] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735 2023-02-13 17:54:53,383 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily regions 2023-02-13 17:54:53,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-13 17:54:53,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-13 17:54:53,790 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-02-13 17:54:53,791 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(7671): creating {ENCODED => 31ed0c2af7cdd1dd637af92056b0a735, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp 2023-02-13 17:54:53,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-13 17:54:54,197 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 17:54:54,197 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1603): Closing 31ed0c2af7cdd1dd637af92056b0a735, disabling compactions & flushes 2023-02-13 17:54:54,197 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735. 2023-02-13 17:54:54,197 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735. 2023-02-13 17:54:54,197 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735. after waiting 0 ms 2023-02-13 17:54:54,197 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735. 2023-02-13 17:54:54,197 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735. 2023-02-13 17:54:54,198 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1557): Region close journal for 31ed0c2af7cdd1dd637af92056b0a735: Waiting for close lock at 1676310894197Disabling compacts and flushes for region at 1676310894197Disabling writes for close at 1676310894197Writing region close event to WAL at 1676310894197Closed at 1676310894197 2023-02-13 17:54:54,199 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 17:54:54,200 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676310894200"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676310894200"}]},"ts":"1676310894200"} 2023-02-13 17:54:54,202 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 17:54:54,202 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 17:54:54,202 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676310894202"}]},"ts":"1676310894202"} 2023-02-13 17:54:54,203 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLING in hbase:meta 2023-02-13 17:54:54,207 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=31ed0c2af7cdd1dd637af92056b0a735, ASSIGN}] 2023-02-13 17:54:54,208 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=31ed0c2af7cdd1dd637af92056b0a735, ASSIGN 2023-02-13 17:54:54,209 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=31ed0c2af7cdd1dd637af92056b0a735, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38881,1676310818035; forceNewPlan=false, retain=false 2023-02-13 17:54:54,360 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=31ed0c2af7cdd1dd637af92056b0a735, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:54,360 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676310894360"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676310894360"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676310894360"}]},"ts":"1676310894360"} 2023-02-13 17:54:54,362 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=57, ppid=56, state=RUNNABLE; OpenRegionProcedure 31ed0c2af7cdd1dd637af92056b0a735, server=jenkins-hbase4.apache.org,38881,1676310818035}] 2023-02-13 17:54:54,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-13 17:54:54,516 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735. 2023-02-13 17:54:54,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 31ed0c2af7cdd1dd637af92056b0a735, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735.', STARTKEY => '', ENDKEY => ''} 2023-02-13 17:54:54,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 31ed0c2af7cdd1dd637af92056b0a735 2023-02-13 17:54:54,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 17:54:54,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 31ed0c2af7cdd1dd637af92056b0a735 2023-02-13 17:54:54,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 31ed0c2af7cdd1dd637af92056b0a735 2023-02-13 17:54:54,517 INFO [StoreOpener-31ed0c2af7cdd1dd637af92056b0a735-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 31ed0c2af7cdd1dd637af92056b0a735 2023-02-13 17:54:54,519 DEBUG [StoreOpener-31ed0c2af7cdd1dd637af92056b0a735-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1 2023-02-13 17:54:54,519 DEBUG [StoreOpener-31ed0c2af7cdd1dd637af92056b0a735-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1 2023-02-13 17:54:54,519 INFO [StoreOpener-31ed0c2af7cdd1dd637af92056b0a735-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 31ed0c2af7cdd1dd637af92056b0a735 columnFamilyName family1 2023-02-13 17:54:54,520 INFO [StoreOpener-31ed0c2af7cdd1dd637af92056b0a735-1] regionserver.HStore(310): Store=31ed0c2af7cdd1dd637af92056b0a735/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 17:54:54,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735 2023-02-13 17:54:54,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735 2023-02-13 17:54:54,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 31ed0c2af7cdd1dd637af92056b0a735 2023-02-13 17:54:54,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 17:54:54,526 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 31ed0c2af7cdd1dd637af92056b0a735; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65138624, jitterRate=-0.029358863830566406}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 17:54:54,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 31ed0c2af7cdd1dd637af92056b0a735: Running coprocessor pre-open hook at 1676310894516Writing region info on filesystem at 1676310894516Initializing all the Stores at 1676310894517 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1676310894517Cleaning up temporary data from old regions at 1676310894522 (+5 ms)Cleaning up detritus from prior splits at 1676310894522Running coprocessor post-open hooks at 1676310894526 (+4 ms)Region opened successfully at 1676310894526 2023-02-13 17:54:54,527 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735., pid=57, masterSystemTime=1676310894513 2023-02-13 17:54:54,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735. 2023-02-13 17:54:54,528 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735. 2023-02-13 17:54:54,529 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=31ed0c2af7cdd1dd637af92056b0a735, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:54,529 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676310894528"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676310894528"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676310894528"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676310894528"}]},"ts":"1676310894528"} 2023-02-13 17:54:54,531 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=57, resume processing ppid=56 2023-02-13 17:54:54,531 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=57, ppid=56, state=SUCCESS; OpenRegionProcedure 31ed0c2af7cdd1dd637af92056b0a735, server=jenkins-hbase4.apache.org,38881,1676310818035 in 168 msec 2023-02-13 17:54:54,533 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=56, resume processing ppid=55 2023-02-13 17:54:54,533 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=56, ppid=55, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=31ed0c2af7cdd1dd637af92056b0a735, ASSIGN in 324 msec 2023-02-13 17:54:54,533 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 17:54:54,534 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676310894533"}]},"ts":"1676310894533"} 2023-02-13 17:54:54,534 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLED in hbase:meta 2023-02-13 17:54:54,536 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 17:54:54,537 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=55, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1580 sec 2023-02-13 17:54:55,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-13 17:54:55,486 INFO [Listener at localhost/35343] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, procId: 55 completed 2023-02-13 17:54:55,506 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:54:55,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:55,507 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 17:54:55,507 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:55,507 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-13 17:54:55,507 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-13 17:54:55,508 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:55,508 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:55,509 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:55,509 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:55,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:55,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:55,509 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:55,509 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:54:55,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:55,510 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:55,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:54:55,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:55,510 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:55,511 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:55,511 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-13 17:54:55,511 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:55,511 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-13 17:54:55,511 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:54:55,511 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:54:55,511 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735. 2023-02-13 17:54:55,511 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735. started... 2023-02-13 17:54:55,512 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 31ed0c2af7cdd1dd637af92056b0a735 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-13 17:54:55,934 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130a541c75289a4490893650b2b777c4f09 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130a541c75289a4490893650b2b777c4f09 2023-02-13 17:54:56,338 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/.tmp/family1/dc1152b3332b46dcbfa1b0a3593c82bd 2023-02-13 17:54:56,343 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/.tmp/family1/dc1152b3332b46dcbfa1b0a3593c82bd as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/dc1152b3332b46dcbfa1b0a3593c82bd 2023-02-13 17:54:56,347 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/dc1152b3332b46dcbfa1b0a3593c82bd, entries=1000, sequenceid=5, filesize=190.5 K 2023-02-13 17:54:56,348 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 31ed0c2af7cdd1dd637af92056b0a735 in 836ms, sequenceid=5, compaction requested=false 2023-02-13 17:54:56,348 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 17:54:56,349 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 31ed0c2af7cdd1dd637af92056b0a735: 2023-02-13 17:54:56,349 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735. 2023-02-13 17:54:56,349 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:54:56,349 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:54:56,349 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:56,349 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-13 17:54:56,349 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-13 17:54:56,350 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:56,350 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:56,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:56,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:56,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:56,351 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:56,351 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:54:56,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:56,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:56,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:56,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:56,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:56,352 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-13 17:54:56,352 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@534ecfb9[Count = 0] remaining members to acquire global barrier 2023-02-13 17:54:56,352 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-13 17:54:56,352 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:56,353 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:56,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:56,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:56,353 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-13 17:54:56,353 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-13 17:54:56,354 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:54:56,354 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:56,354 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:54:56,356 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-13 17:54:56,356 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:56,356 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:56,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:56,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:56,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:56,356 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-13 17:54:56,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:56,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:56,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:56,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:56,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:56,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:56,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:56,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:54:56,358 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-13 17:54:56,358 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-13 17:54:56,358 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:54:56,358 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:54:56,358 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:56,358 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:54:56,360 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:56,360 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:56,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:56,360 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:56,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:56,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:56,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:56,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:56,361 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:56,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:56,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:56,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:56,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:56,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:56,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:56,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:56,362 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:56,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:56,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:56,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:56,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:56,366 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:56,366 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:56,366 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:56,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:56,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:56,366 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:56,366 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 17:54:56,367 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:54:56,367 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-13 17:54:56,366 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:56,366 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:56,367 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:56,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:56,367 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-13 17:54:56,367 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:54:56,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:56,367 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:56,367 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:56,367 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:56,467 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:54:56,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:54:56,471 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:54:56,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-13 17:54:56,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:56,473 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 17:54:56,473 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:56,473 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-13 17:54:56,473 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-13 17:54:56,473 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:56,474 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:56,479 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:56,479 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:56,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:56,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:56,479 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:56,479 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:54:56,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:56,479 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:56,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:54:56,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:56,480 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:56,480 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-13 17:54:56,480 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:56,480 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-13 17:54:56,480 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:56,480 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-13 17:54:56,480 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:54:56,480 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:54:56,480 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735. 2023-02-13 17:54:56,480 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735. started... 2023-02-13 17:54:56,480 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 31ed0c2af7cdd1dd637af92056b0a735 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-13 17:54:56,621 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 17:54:56,892 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112897d135120ffe45a6a85a759076fe232e to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112897d135120ffe45a6a85a759076fe232e 2023-02-13 17:54:57,301 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/.tmp/family1/6c010e1a4ab54bf2a069b1dca240dfaa 2023-02-13 17:54:57,306 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/.tmp/family1/6c010e1a4ab54bf2a069b1dca240dfaa as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/6c010e1a4ab54bf2a069b1dca240dfaa 2023-02-13 17:54:57,310 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/6c010e1a4ab54bf2a069b1dca240dfaa, entries=1, sequenceid=9, filesize=5.0 K 2023-02-13 17:54:57,311 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 31ed0c2af7cdd1dd637af92056b0a735 in 831ms, sequenceid=9, compaction requested=false 2023-02-13 17:54:57,311 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 31ed0c2af7cdd1dd637af92056b0a735: 2023-02-13 17:54:57,311 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735. 2023-02-13 17:54:57,311 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:54:57,311 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:54:57,311 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:57,311 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-13 17:54:57,311 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-13 17:54:57,312 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:57,312 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:57,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:57,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:57,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:57,313 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:57,313 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:54:57,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:57,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:57,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:57,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:57,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:57,314 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-13 17:54:57,314 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7de9f40b[Count = 0] remaining members to acquire global barrier 2023-02-13 17:54:57,314 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-13 17:54:57,314 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:57,316 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:57,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:57,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:57,316 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-13 17:54:57,316 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-13 17:54:57,316 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:54:57,316 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:57,316 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:54:57,317 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:57,317 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-13 17:54:57,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:57,317 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:57,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:57,317 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-13 17:54:57,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:57,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:57,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:57,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:57,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:57,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:57,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:57,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:57,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:54:57,319 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-13 17:54:57,319 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-13 17:54:57,319 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:54:57,320 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:54:57,320 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:57,320 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:54:57,322 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:57,322 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:57,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:57,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:57,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:57,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:57,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:57,322 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:57,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:57,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:57,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:57,323 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:57,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:57,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:57,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:57,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:57,324 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:57,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:57,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:57,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:57,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:57,326 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:57,326 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:57,326 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:57,326 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:57,326 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:57,326 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:57,326 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 17:54:57,326 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:54:57,326 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-13 17:54:57,326 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:57,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:57,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:57,326 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:57,326 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:57,326 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:57,326 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-13 17:54:57,326 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:54:57,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:57,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:57,426 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:54:57,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:54:57,431 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:54:57,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-13 17:54:57,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:57,432 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 17:54:57,432 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:57,432 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-13 17:54:57,432 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-13 17:54:57,433 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:57,433 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:57,434 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:57,434 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:57,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:57,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:57,434 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:57,434 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:54:57,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:57,435 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:57,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:54:57,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:57,435 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:57,435 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-13 17:54:57,435 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:57,435 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-13 17:54:57,435 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:57,435 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-13 17:54:57,436 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:54:57,436 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:54:57,436 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735. 2023-02-13 17:54:57,436 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735. started... 2023-02-13 17:54:57,436 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 31ed0c2af7cdd1dd637af92056b0a735 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 17:54:57,848 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201437d6acb03db4500834d8b905173a68c to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201437d6acb03db4500834d8b905173a68c 2023-02-13 17:54:58,253 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/.tmp/family1/2d79a8bcba344ff295f441fb5fc8a4da 2023-02-13 17:54:58,257 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/.tmp/family1/2d79a8bcba344ff295f441fb5fc8a4da as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/2d79a8bcba344ff295f441fb5fc8a4da 2023-02-13 17:54:58,261 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/2d79a8bcba344ff295f441fb5fc8a4da, entries=1, sequenceid=13, filesize=5.0 K 2023-02-13 17:54:58,262 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 31ed0c2af7cdd1dd637af92056b0a735 in 826ms, sequenceid=13, compaction requested=true 2023-02-13 17:54:58,262 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 31ed0c2af7cdd1dd637af92056b0a735: 2023-02-13 17:54:58,262 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735. 2023-02-13 17:54:58,262 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:54:58,262 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:54:58,262 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:58,262 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-13 17:54:58,262 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-13 17:54:58,263 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:58,263 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:58,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:58,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:58,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:58,264 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:58,264 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:54:58,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:58,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:58,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:58,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:58,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:58,265 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-13 17:54:58,265 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@31135813[Count = 0] remaining members to acquire global barrier 2023-02-13 17:54:58,265 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-13 17:54:58,265 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:58,267 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:58,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:58,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:58,267 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-13 17:54:58,267 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-13 17:54:58,267 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:58,268 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:54:58,267 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:54:58,269 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:58,269 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-13 17:54:58,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:58,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:58,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:58,269 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:58,269 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-13 17:54:58,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:58,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:58,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:58,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:58,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:58,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:58,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:58,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:54:58,271 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-13 17:54:58,271 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-13 17:54:58,271 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:54:58,271 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:54:58,271 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:58,271 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:54:58,273 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:58,273 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:58,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:58,273 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:58,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:58,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:58,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:58,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:58,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:58,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:58,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:58,273 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:58,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:58,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:58,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:58,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:58,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:58,275 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:58,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:58,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:58,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:58,277 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:58,277 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:58,277 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:58,277 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:58,277 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:58,277 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:58,277 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-13 17:54:58,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:58,277 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 17:54:58,277 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:54:58,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:58,277 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:58,277 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:58,277 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:58,277 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:58,277 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-13 17:54:58,277 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:54:58,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:58,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:58,377 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:54:58,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:54:58,381 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:54:58,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-13 17:54:58,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:58,383 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 17:54:58,383 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:58,383 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-13 17:54:58,383 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-13 17:54:58,384 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:58,384 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:58,388 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:58,388 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:58,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:58,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:58,388 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:58,388 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:54:58,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:58,389 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:58,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:54:58,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:58,389 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:58,389 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-13 17:54:58,389 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:58,389 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-13 17:54:58,389 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:58,389 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-13 17:54:58,390 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:54:58,390 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:54:58,390 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735. 2023-02-13 17:54:58,390 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735. started... 2023-02-13 17:54:58,390 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 31ed0c2af7cdd1dd637af92056b0a735 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 17:54:58,801 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205e6ac7d4e045a458a93aca5d3b4b18909 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205e6ac7d4e045a458a93aca5d3b4b18909 2023-02-13 17:54:59,226 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 17:54:59,226 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x76938106 to 127.0.0.1:64825 2023-02-13 17:54:59,226 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 17:54:59,226 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6f36c65b to 127.0.0.1:64825 2023-02-13 17:54:59,226 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/.tmp/family1/5dd80c500fbd4b1593ed3b93ddd210c0 2023-02-13 17:54:59,226 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 17:54:59,227 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 17:54:59,227 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2aef95a4 to 127.0.0.1:64825 2023-02-13 17:54:59,227 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 17:54:59,228 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 17:54:59,228 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7fc51d06 to 127.0.0.1:64825 2023-02-13 17:54:59,228 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 17:54:59,228 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 17:54:59,228 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0f172e0d to 127.0.0.1:64825 2023-02-13 17:54:59,228 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 17:54:59,232 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/.tmp/family1/5dd80c500fbd4b1593ed3b93ddd210c0 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/5dd80c500fbd4b1593ed3b93ddd210c0 2023-02-13 17:54:59,236 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/5dd80c500fbd4b1593ed3b93ddd210c0, entries=1, sequenceid=17, filesize=5.0 K 2023-02-13 17:54:59,237 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 31ed0c2af7cdd1dd637af92056b0a735 in 847ms, sequenceid=17, compaction requested=true 2023-02-13 17:54:59,237 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 31ed0c2af7cdd1dd637af92056b0a735: 2023-02-13 17:54:59,237 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735. 2023-02-13 17:54:59,237 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:54:59,237 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:54:59,237 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:59,237 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-13 17:54:59,237 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-13 17:54:59,241 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:59,241 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:59,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:59,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:59,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:59,241 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:59,241 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:54:59,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:59,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:59,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:59,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:59,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:59,242 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-13 17:54:59,242 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3cd17b4a[Count = 0] remaining members to acquire global barrier 2023-02-13 17:54:59,242 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-13 17:54:59,242 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:59,243 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:59,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:59,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:59,243 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-13 17:54:59,244 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:59,244 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:54:59,244 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-13 17:54:59,244 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:54:59,246 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:59,246 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-13 17:54:59,246 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:59,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:59,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:59,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:59,246 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-13 17:54:59,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:59,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:59,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:59,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:59,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:59,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:59,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:59,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:54:59,248 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-13 17:54:59,248 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-13 17:54:59,248 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:54:59,248 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:54:59,248 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:59,248 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:54:59,249 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:59,250 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:59,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:59,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:54:59,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:54:59,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:59,250 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:59,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:59,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:54:59,250 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:59,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:59,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:59,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:59,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:59,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:54:59,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:59,251 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:59,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:59,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:54:59,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:59,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:59,253 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:59,253 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:59,253 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:59,253 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:59,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:59,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:59,253 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:54:59,253 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 17:54:59,253 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:54:59,253 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:59,253 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:54:59,253 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:59,253 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:59,253 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:59,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:54:59,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:54:59,253 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-13 17:54:59,254 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:54:59,354 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:54:59,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:54:59,357 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:54:59,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-13 17:54:59,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:59,359 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 17:54:59,359 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:59,359 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-13 17:54:59,359 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-13 17:54:59,360 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:59,360 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:59,361 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:59,361 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:54:59,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:54:59,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:54:59,361 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:54:59,361 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:54:59,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:59,361 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:59,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:54:59,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:59,362 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:59,362 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-13 17:54:59,362 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:54:59,362 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-13 17:54:59,362 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:54:59,362 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-13 17:54:59,362 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:54:59,362 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:54:59,362 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735. 2023-02-13 17:54:59,362 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735. started... 2023-02-13 17:54:59,362 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 31ed0c2af7cdd1dd637af92056b0a735 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 17:54:59,775 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512287f188bb5a2524079aab107e8e686bd60 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512287f188bb5a2524079aab107e8e686bd60 2023-02-13 17:55:00,180 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/.tmp/family1/b02f8cb00ee043928ad3ead2abf47521 2023-02-13 17:55:00,185 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/.tmp/family1/b02f8cb00ee043928ad3ead2abf47521 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/b02f8cb00ee043928ad3ead2abf47521 2023-02-13 17:55:00,189 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/b02f8cb00ee043928ad3ead2abf47521, entries=1, sequenceid=21, filesize=5.0 K 2023-02-13 17:55:00,190 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 31ed0c2af7cdd1dd637af92056b0a735 in 828ms, sequenceid=21, compaction requested=true 2023-02-13 17:55:00,190 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 31ed0c2af7cdd1dd637af92056b0a735: 2023-02-13 17:55:00,190 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735. 2023-02-13 17:55:00,190 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:55:00,190 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:55:00,190 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:00,190 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-13 17:55:00,190 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-13 17:55:00,191 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:00,191 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:00,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:00,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:55:00,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:55:00,192 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:00,192 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:55:00,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:55:00,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:55:00,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:00,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:00,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:55:00,193 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-13 17:55:00,193 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@19c7586e[Count = 0] remaining members to acquire global barrier 2023-02-13 17:55:00,193 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-13 17:55:00,193 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:00,194 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:00,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:00,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:00,195 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-13 17:55:00,195 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-13 17:55:00,195 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:00,195 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:55:00,195 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:55:00,196 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:00,196 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-13 17:55:00,196 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:55:00,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:00,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:55:00,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:55:00,196 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-13 17:55:00,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:55:00,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:55:00,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:00,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:00,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:55:00,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:00,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:00,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:55:00,199 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-13 17:55:00,199 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-13 17:55:00,199 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:55:00,199 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:55:00,199 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:00,199 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:55:00,205 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:00,205 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:00,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:00,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:00,205 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:55:00,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:00,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:55:00,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:55:00,205 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:00,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:55:00,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:55:00,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:55:00,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:00,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:00,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:55:00,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:00,206 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:00,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:00,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:55:00,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:00,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:00,208 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:55:00,208 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:00,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:55:00,208 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:55:00,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:55:00,209 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:55:00,209 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:00,209 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:00,209 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:00,209 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:00,209 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:00,209 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:00,209 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 17:55:00,209 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-13 17:55:00,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:55:00,209 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:55:00,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:55:00,209 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-13 17:55:00,209 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:55:00,309 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:55:00,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:55:00,314 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:55:00,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-13 17:55:00,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:00,316 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 17:55:00,316 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:55:00,316 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-13 17:55:00,316 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-13 17:55:00,316 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:00,316 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:00,317 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:55:00,317 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:00,317 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:55:00,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:55:00,318 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:00,318 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:55:00,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:00,318 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:00,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:55:00,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:00,318 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:00,319 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-13 17:55:00,319 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:00,319 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-13 17:55:00,319 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:55:00,319 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-13 17:55:00,319 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:55:00,319 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:55:00,319 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735. 2023-02-13 17:55:00,319 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735. started... 2023-02-13 17:55:00,319 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 31ed0c2af7cdd1dd637af92056b0a735 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 17:55:00,732 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231b5d081e7e7f6408599c5df0cbbb770eb to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231b5d081e7e7f6408599c5df0cbbb770eb 2023-02-13 17:55:01,138 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/.tmp/family1/efbb2941b6f44257b7c78a1df9e37dc0 2023-02-13 17:55:01,142 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/.tmp/family1/efbb2941b6f44257b7c78a1df9e37dc0 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/efbb2941b6f44257b7c78a1df9e37dc0 2023-02-13 17:55:01,145 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/efbb2941b6f44257b7c78a1df9e37dc0, entries=1, sequenceid=25, filesize=5.0 K 2023-02-13 17:55:01,146 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 31ed0c2af7cdd1dd637af92056b0a735 in 827ms, sequenceid=25, compaction requested=true 2023-02-13 17:55:01,146 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 31ed0c2af7cdd1dd637af92056b0a735: 2023-02-13 17:55:01,146 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735. 2023-02-13 17:55:01,146 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:55:01,146 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:55:01,147 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:01,147 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-13 17:55:01,147 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-13 17:55:01,148 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:01,148 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:01,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:01,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:55:01,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:55:01,149 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:01,149 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:55:01,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:55:01,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:55:01,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:01,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:01,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:55:01,150 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-13 17:55:01,150 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2b3caef1[Count = 0] remaining members to acquire global barrier 2023-02-13 17:55:01,150 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-13 17:55:01,150 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:01,152 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:01,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:01,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:01,152 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-13 17:55:01,152 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-13 17:55:01,152 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:55:01,152 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:01,152 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:55:01,153 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:01,153 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-13 17:55:01,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:01,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:55:01,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:55:01,154 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:55:01,154 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-13 17:55:01,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:55:01,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:55:01,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:01,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:01,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:55:01,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:01,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:01,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:55:01,156 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-13 17:55:01,156 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-13 17:55:01,156 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:55:01,156 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:55:01,156 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:01,156 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:55:01,157 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:01,157 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:01,157 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:55:01,157 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:01,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:01,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:01,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:55:01,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:55:01,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:55:01,158 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:01,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:55:01,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:55:01,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:01,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:01,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:55:01,159 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:01,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:01,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:01,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:55:01,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:01,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:01,164 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:01,165 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:01,165 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:01,165 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:01,165 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:01,165 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 17:55:01,165 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:55:01,164 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:55:01,165 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:01,165 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:01,165 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:55:01,165 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-13 17:55:01,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:55:01,165 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-13 17:55:01,165 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:55:01,165 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:55:01,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:55:01,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:55:01,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:55:01,265 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:55:01,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:55:01,270 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:55:01,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-13 17:55:01,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:01,271 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 17:55:01,271 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:55:01,271 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-13 17:55:01,271 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-13 17:55:01,272 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:01,272 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:01,276 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:01,276 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:55:01,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:55:01,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:55:01,276 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:01,276 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:55:01,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:01,276 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:01,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:55:01,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:01,277 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:01,277 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-13 17:55:01,277 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:01,277 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-13 17:55:01,277 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:55:01,277 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-13 17:55:01,277 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:55:01,277 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:55:01,277 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735. 2023-02-13 17:55:01,277 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735. started... 2023-02-13 17:55:01,277 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 31ed0c2af7cdd1dd637af92056b0a735 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 17:55:01,690 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101449b109bba6c40c9b77dabd4ac927484 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101449b109bba6c40c9b77dabd4ac927484 2023-02-13 17:55:02,095 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/.tmp/family1/6a78a2fa3fb3416fa82f255420cc7af5 2023-02-13 17:55:02,100 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/.tmp/family1/6a78a2fa3fb3416fa82f255420cc7af5 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/6a78a2fa3fb3416fa82f255420cc7af5 2023-02-13 17:55:02,103 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/6a78a2fa3fb3416fa82f255420cc7af5, entries=1, sequenceid=29, filesize=5.0 K 2023-02-13 17:55:02,104 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 31ed0c2af7cdd1dd637af92056b0a735 in 827ms, sequenceid=29, compaction requested=true 2023-02-13 17:55:02,104 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 31ed0c2af7cdd1dd637af92056b0a735: 2023-02-13 17:55:02,104 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735. 2023-02-13 17:55:02,104 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:55:02,104 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:55:02,104 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:02,104 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-13 17:55:02,104 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-13 17:55:02,106 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:02,106 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:02,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:02,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:55:02,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:55:02,106 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:02,106 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:55:02,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:55:02,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:55:02,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:02,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:02,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:55:02,107 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-13 17:55:02,107 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@44b845[Count = 0] remaining members to acquire global barrier 2023-02-13 17:55:02,107 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-13 17:55:02,107 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:02,110 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:02,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:02,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:02,110 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-13 17:55:02,110 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-13 17:55:02,110 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:55:02,110 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:02,110 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:55:02,111 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-13 17:55:02,111 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:02,111 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:55:02,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:02,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:55:02,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:55:02,111 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-13 17:55:02,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:55:02,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:55:02,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:02,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:02,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:55:02,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:02,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:02,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:55:02,113 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-13 17:55:02,113 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-13 17:55:02,114 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:55:02,114 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:55:02,114 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:02,114 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:55:02,115 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:02,115 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:02,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:02,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:02,115 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:55:02,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:02,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:55:02,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:55:02,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:55:02,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:55:02,116 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:02,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:55:02,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:02,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:02,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:55:02,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:02,117 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:02,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:02,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:55:02,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:02,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:02,119 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:02,119 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:02,119 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:55:02,119 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:02,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:55:02,119 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:02,119 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 17:55:02,119 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:02,119 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-13 17:55:02,119 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:55:02,119 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:55:02,119 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:02,119 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:55:02,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:55:02,120 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:02,120 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-13 17:55:02,120 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:55:02,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:55:02,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:55:02,220 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:55:02,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:55:02,225 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:55:02,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-13 17:55:02,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:02,226 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 17:55:02,226 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:55:02,226 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-13 17:55:02,226 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-13 17:55:02,227 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:02,227 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:02,229 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:02,229 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:55:02,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:55:02,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:55:02,230 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:02,230 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:55:02,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:02,230 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:02,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:55:02,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:02,230 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:02,230 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-13 17:55:02,230 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:02,231 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-13 17:55:02,231 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:55:02,231 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-13 17:55:02,240 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:55:02,240 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:55:02,240 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735. 2023-02-13 17:55:02,240 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735. started... 2023-02-13 17:55:02,240 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 31ed0c2af7cdd1dd637af92056b0a735 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 17:55:02,654 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010308728f0c704149a491b9e4f1d20ae4b2 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010308728f0c704149a491b9e4f1d20ae4b2 2023-02-13 17:55:03,061 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/.tmp/family1/18048356dc1b4814be1ec13aa6352fc4 2023-02-13 17:55:03,066 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/.tmp/family1/18048356dc1b4814be1ec13aa6352fc4 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/18048356dc1b4814be1ec13aa6352fc4 2023-02-13 17:55:03,069 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/18048356dc1b4814be1ec13aa6352fc4, entries=1, sequenceid=33, filesize=5.0 K 2023-02-13 17:55:03,070 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 31ed0c2af7cdd1dd637af92056b0a735 in 830ms, sequenceid=33, compaction requested=true 2023-02-13 17:55:03,070 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 31ed0c2af7cdd1dd637af92056b0a735: 2023-02-13 17:55:03,070 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735. 2023-02-13 17:55:03,070 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:55:03,070 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:55:03,070 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:03,070 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-13 17:55:03,070 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-13 17:55:03,072 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:03,072 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:03,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:03,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:55:03,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:55:03,072 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:03,072 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:55:03,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:55:03,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:55:03,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:03,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:03,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:55:03,074 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-13 17:55:03,074 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3778882c[Count = 0] remaining members to acquire global barrier 2023-02-13 17:55:03,074 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-13 17:55:03,074 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:03,075 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:03,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:03,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:03,075 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-13 17:55:03,075 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:03,075 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:55:03,075 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-13 17:55:03,075 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:55:03,076 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-13 17:55:03,076 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:55:03,076 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:03,076 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-13 17:55:03,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:03,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:55:03,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:55:03,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:55:03,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:55:03,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:03,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:03,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:55:03,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:03,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:03,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:55:03,078 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-13 17:55:03,078 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-13 17:55:03,078 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:55:03,078 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:55:03,078 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:03,078 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:55:03,081 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:03,081 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:03,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:03,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:03,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:55:03,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:03,081 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:55:03,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:55:03,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:55:03,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:55:03,081 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:03,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:55:03,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:03,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:03,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:55:03,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:03,082 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:03,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:03,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:55:03,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:03,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:03,084 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:03,084 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:55:03,084 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:03,084 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:55:03,084 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 17:55:03,084 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:55:03,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:55:03,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:55:03,084 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:55:03,084 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:03,085 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:03,085 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:03,085 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-13 17:55:03,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:55:03,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:55:03,085 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:03,085 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:55:03,085 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:03,185 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:55:03,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:55:03,189 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:55:03,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-13 17:55:03,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:03,191 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 17:55:03,191 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:55:03,191 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-13 17:55:03,191 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-13 17:55:03,191 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:03,191 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:03,192 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:03,192 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:55:03,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:55:03,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:55:03,193 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:03,193 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:55:03,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:03,193 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:03,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:55:03,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:03,193 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:03,193 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-13 17:55:03,194 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:03,194 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-13 17:55:03,194 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:55:03,194 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-13 17:55:03,194 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:55:03,194 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:55:03,194 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735. 2023-02-13 17:55:03,194 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735. started... 2023-02-13 17:55:03,194 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 31ed0c2af7cdd1dd637af92056b0a735 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 17:55:03,607 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907e97dc4b667d646388826de0d7d71ef42 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20150907e97dc4b667d646388826de0d7d71ef42 2023-02-13 17:55:04,012 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/.tmp/family1/81b5e660c0334535a8902530ed70b3ee 2023-02-13 17:55:04,016 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/.tmp/family1/81b5e660c0334535a8902530ed70b3ee as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/81b5e660c0334535a8902530ed70b3ee 2023-02-13 17:55:04,018 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/81b5e660c0334535a8902530ed70b3ee, entries=1, sequenceid=37, filesize=5.0 K 2023-02-13 17:55:04,019 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 31ed0c2af7cdd1dd637af92056b0a735 in 825ms, sequenceid=37, compaction requested=true 2023-02-13 17:55:04,019 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 31ed0c2af7cdd1dd637af92056b0a735: 2023-02-13 17:55:04,019 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735. 2023-02-13 17:55:04,019 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:55:04,019 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:55:04,019 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:04,019 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-13 17:55:04,020 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-13 17:55:04,022 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:04,022 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:04,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:04,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:55:04,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:55:04,022 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:04,022 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:55:04,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:55:04,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:55:04,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:04,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:04,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:55:04,023 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-13 17:55:04,023 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@14dfb285[Count = 0] remaining members to acquire global barrier 2023-02-13 17:55:04,023 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-13 17:55:04,023 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:04,024 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:04,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:04,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:04,025 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-13 17:55:04,025 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-13 17:55:04,025 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:55:04,025 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:04,025 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:55:04,026 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:04,026 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-13 17:55:04,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:04,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:55:04,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:55:04,026 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:55:04,026 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-13 17:55:04,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:55:04,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:55:04,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:04,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:04,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:55:04,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:04,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:04,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:55:04,028 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-13 17:55:04,028 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-13 17:55:04,028 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:55:04,028 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:55:04,028 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:04,028 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:55:04,029 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:04,029 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:04,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:04,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:04,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:55:04,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:55:04,029 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:55:04,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:04,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:55:04,030 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:04,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:55:04,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:55:04,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:04,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:04,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:55:04,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:04,031 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:04,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:04,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:55:04,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:04,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:04,034 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:04,034 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:55:04,034 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:04,034 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:55:04,034 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 17:55:04,034 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-13 17:55:04,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:55:04,034 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:55:04,034 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:55:04,034 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:04,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:55:04,035 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:04,035 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:04,035 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:04,035 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:04,035 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-13 17:55:04,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:55:04,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:55:04,035 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:55:04,135 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:55:04,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:55:04,139 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:55:04,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-13 17:55:04,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:04,140 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 17:55:04,140 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:55:04,141 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-13 17:55:04,141 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-13 17:55:04,141 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:04,141 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:04,142 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:04,142 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:55:04,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:55:04,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:55:04,142 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:04,142 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:55:04,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:04,143 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:04,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:55:04,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:04,143 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:04,143 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-13 17:55:04,143 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:04,143 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-13 17:55:04,143 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:55:04,143 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-13 17:55:04,144 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:55:04,144 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:55:04,144 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735. 2023-02-13 17:55:04,144 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735. started... 2023-02-13 17:55:04,144 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 31ed0c2af7cdd1dd637af92056b0a735 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 17:55:04,554 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112083db0fcbcf8b44828423f9cbfde5a465 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112083db0fcbcf8b44828423f9cbfde5a465 2023-02-13 17:55:04,959 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/.tmp/family1/3c7d81a2c1be4e2a96b09c572a7a2c69 2023-02-13 17:55:04,963 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/.tmp/family1/3c7d81a2c1be4e2a96b09c572a7a2c69 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/3c7d81a2c1be4e2a96b09c572a7a2c69 2023-02-13 17:55:04,966 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/3c7d81a2c1be4e2a96b09c572a7a2c69, entries=1, sequenceid=41, filesize=5.0 K 2023-02-13 17:55:04,967 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 31ed0c2af7cdd1dd637af92056b0a735 in 823ms, sequenceid=41, compaction requested=true 2023-02-13 17:55:04,967 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 31ed0c2af7cdd1dd637af92056b0a735: 2023-02-13 17:55:04,967 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735. 2023-02-13 17:55:04,967 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:55:04,968 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:55:04,968 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:04,968 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-13 17:55:04,968 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-13 17:55:04,969 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:04,969 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:04,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:04,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:55:04,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:55:04,969 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:04,969 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:55:04,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:55:04,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:55:04,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:04,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:04,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:55:04,971 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-13 17:55:04,971 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a5addc9[Count = 0] remaining members to acquire global barrier 2023-02-13 17:55:04,971 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-13 17:55:04,971 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:04,972 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:04,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:04,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:04,972 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-13 17:55:04,972 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:04,972 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:55:04,972 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-13 17:55:04,972 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:55:04,974 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-13 17:55:04,975 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:55:04,974 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:04,975 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-13 17:55:04,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:04,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:55:04,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:55:04,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:55:04,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:55:04,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:04,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:04,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:55:04,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:04,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:04,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:55:04,977 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-13 17:55:04,977 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-13 17:55:04,977 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:55:04,977 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:55:04,977 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:04,977 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:55:04,978 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:04,978 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:04,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:04,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:04,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:55:04,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:55:04,978 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:55:04,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:04,978 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:04,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:55:04,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:55:04,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:55:04,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:04,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:04,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:55:04,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:04,979 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:04,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:04,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:55:04,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:04,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:04,981 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:04,981 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:55:04,981 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:04,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:55:04,981 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-13 17:55:04,981 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:55:04,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:55:04,981 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 17:55:04,982 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:55:04,981 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:55:04,981 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:04,982 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:04,982 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:04,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:55:04,982 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-13 17:55:04,982 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:04,982 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:55:04,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:55:04,982 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:05,082 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:55:05,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:55:05,084 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41433] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:05,085 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] procedure2.ProcedureExecutor(1029): Stored pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-13 17:55:05,086 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-13 17:55:05,087 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 17:55:05,087 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=58, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676311505087 2023-02-13 17:55:05,089 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-13 17:55:05,090 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-02-13 17:55:05,090 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-13 17:55:05,091 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] zookeeper.ReadOnlyZKClient(139): Connect 0x3b302e63 to 127.0.0.1:64825 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 17:55:05,095 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2e3c5ad3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 17:55:05,095 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 17:55:05,927 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103fbdc5282ddee43ea910fa6505450fb48 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103fbdc5282ddee43ea910fa6505450fb48 2023-02-13 17:55:05,928 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-13 17:55:05,940 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 17:55:05,941 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55638, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 17:55:05,947 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 17:55:05,948 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50212, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 17:55:05,956 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/9c3063aba6d440ef806ec547a0a6ae38 first=Optional[r3] last=Optional[r6] 2023-02-13 17:55:05,956 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735., hostname=jenkins-hbase4.apache.org,38881,1676310818035, seqNum=2 for row with hfile group [{family1,hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/9c3063aba6d440ef806ec547a0a6ae38}] 2023-02-13 17:55:05,960 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(763): Validating hfile at hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/9c3063aba6d440ef806ec547a0a6ae38 for inclusion in 31ed0c2af7cdd1dd637af92056b0a735/family1 2023-02-13 17:55:05,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-13 17:55:05,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 17:55:05,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegion(2445): Flush status journal for 31ed0c2af7cdd1dd637af92056b0a735: 2023-02-13 17:55:05,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/9c3063aba6d440ef806ec547a0a6ae38 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__sgtpn46b34dlfbk8e254arsvai869pe1vh8hhri2g8rt73fia13hm6r360455tgh/family1/9c3063aba6d440ef806ec547a0a6ae38 2023-02-13 17:55:05,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__sgtpn46b34dlfbk8e254arsvai869pe1vh8hhri2g8rt73fia13hm6r360455tgh/family1/9c3063aba6d440ef806ec547a0a6ae38 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/c09bdd364441485fb89b12a94ac6da98_SeqId_44_ 2023-02-13 17:55:05,965 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(849): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__sgtpn46b34dlfbk8e254arsvai869pe1vh8hhri2g8rt73fia13hm6r360455tgh/family1/9c3063aba6d440ef806ec547a0a6ae38 into 31ed0c2af7cdd1dd637af92056b0a735/family1 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/c09bdd364441485fb89b12a94ac6da98_SeqId_44_ - updating store file list. 2023-02-13 17:55:05,968 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(882): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/c09bdd364441485fb89b12a94ac6da98_SeqId_44_ into 31ed0c2af7cdd1dd637af92056b0a735/family1 2023-02-13 17:55:05,968 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(855): Successfully loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__sgtpn46b34dlfbk8e254arsvai869pe1vh8hhri2g8rt73fia13hm6r360455tgh/family1/9c3063aba6d440ef806ec547a0a6ae38 into 31ed0c2af7cdd1dd637af92056b0a735/family1 (new location: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/c09bdd364441485fb89b12a94ac6da98_SeqId_44_) 2023-02-13 17:55:05,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__sgtpn46b34dlfbk8e254arsvai869pe1vh8hhri2g8rt73fia13hm6r360455tgh/family1/9c3063aba6d440ef806ec547a0a6ae38 2023-02-13 17:55:05,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-13 17:55:05,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51552 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-13 17:55:05,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(1912): 31ed0c2af7cdd1dd637af92056b0a735/family1 is initiating minor compaction 2023-02-13 17:55:05,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7bb8d37d; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 17:55:05,971 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 31ed0c2af7cdd1dd637af92056b0a735/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735. 2023-02-13 17:55:05,972 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/6c010e1a4ab54bf2a069b1dca240dfaa, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/2d79a8bcba344ff295f441fb5fc8a4da, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/5dd80c500fbd4b1593ed3b93ddd210c0, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/b02f8cb00ee043928ad3ead2abf47521, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/efbb2941b6f44257b7c78a1df9e37dc0, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/6a78a2fa3fb3416fa82f255420cc7af5, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/18048356dc1b4814be1ec13aa6352fc4, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/81b5e660c0334535a8902530ed70b3ee, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/3c7d81a2c1be4e2a96b09c572a7a2c69, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/c09bdd364441485fb89b12a94ac6da98_SeqId_44_] into tmpdir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/.tmp, totalSize=50.3 K 2023-02-13 17:55:05,972 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting 6c010e1a4ab54bf2a069b1dca240dfaa, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-13 17:55:05,972 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting 2d79a8bcba344ff295f441fb5fc8a4da, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-13 17:55:05,972 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting 5dd80c500fbd4b1593ed3b93ddd210c0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-13 17:55:05,972 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting b02f8cb00ee043928ad3ead2abf47521, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-13 17:55:05,972 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting efbb2941b6f44257b7c78a1df9e37dc0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-13 17:55:05,972 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting 6a78a2fa3fb3416fa82f255420cc7af5, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-13 17:55:05,972 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting 18048356dc1b4814be1ec13aa6352fc4, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-13 17:55:05,972 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting 81b5e660c0334535a8902530ed70b3ee, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-13 17:55:05,972 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting 3c7d81a2c1be4e2a96b09c572a7a2c69, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-13 17:55:05,972 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting c09bdd364441485fb89b12a94ac6da98_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-13 17:55:05,974 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-13 17:55:05,974 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:55:05,976 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512287f188bb5a2524079aab107e8e686bd60 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512287f188bb5a2524079aab107e8e686bd60 2023-02-13 17:55:05,977 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231b5d081e7e7f6408599c5df0cbbb770eb to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231b5d081e7e7f6408599c5df0cbbb770eb 2023-02-13 17:55:05,978 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101449b109bba6c40c9b77dabd4ac927484 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101449b109bba6c40c9b77dabd4ac927484 2023-02-13 17:55:05,979 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010308728f0c704149a491b9e4f1d20ae4b2 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010308728f0c704149a491b9e4f1d20ae4b2 2023-02-13 17:55:05,979 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4 expired mob files are deleted 2023-02-13 17:55:05,979 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-13 17:55:05,979 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 17:55:05,979 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 17:55:05,980 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 17:55:05,980 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 17:55:05,980 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 17:55:05,980 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 17:55:05,980 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 17:55:05,980 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 17:55:06,005 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] throttle.PressureAwareThroughputController(145): 31ed0c2af7cdd1dd637af92056b0a735#family1#compaction#73 average throughput is 1.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 17:55:06,819 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/.tmp/family1/92a58b9906204bdf976bac5ee245579d as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/92a58b9906204bdf976bac5ee245579d 2023-02-13 17:55:06,824 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 31ed0c2af7cdd1dd637af92056b0a735/family1 of 31ed0c2af7cdd1dd637af92056b0a735 into 92a58b9906204bdf976bac5ee245579d(size=6.8 K), total size for store is 197.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 17:55:06,824 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 31ed0c2af7cdd1dd637af92056b0a735: 2023-02-13 17:55:06,824 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735., storeName=family1, fileCount=10, fileSize=50.3 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1676310905971; duration=0sec 2023-02-13 17:55:06,824 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 17:55:06,825 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512054846880e370c4054a261529b121dcd60 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512054846880e370c4054a261529b121dcd60 2023-02-13 17:55:06,826 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-13 17:55:06,851 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/1d1a94a71d014dc0a7faa524986ed09f first=Optional[r00] last=Optional[r2] 2023-02-13 17:55:06,852 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735., hostname=jenkins-hbase4.apache.org,38881,1676310818035, seqNum=2 for row with hfile group [{family1,hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/1d1a94a71d014dc0a7faa524986ed09f}] 2023-02-13 17:55:06,854 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(763): Validating hfile at hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/1d1a94a71d014dc0a7faa524986ed09f for inclusion in 31ed0c2af7cdd1dd637af92056b0a735/family1 2023-02-13 17:55:06,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-02-13 17:55:06,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 17:55:06,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegion(2445): Flush status journal for 31ed0c2af7cdd1dd637af92056b0a735: 2023-02-13 17:55:06,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/1d1a94a71d014dc0a7faa524986ed09f to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__8o4e0ifssoedhn86ekg1g85alif3pkif4ekqku7cvhr14k8u2916nla0qek3d6fk/family1/1d1a94a71d014dc0a7faa524986ed09f 2023-02-13 17:55:06,871 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/6c010e1a4ab54bf2a069b1dca240dfaa, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/2d79a8bcba344ff295f441fb5fc8a4da, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/5dd80c500fbd4b1593ed3b93ddd210c0, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/b02f8cb00ee043928ad3ead2abf47521, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/efbb2941b6f44257b7c78a1df9e37dc0, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/6a78a2fa3fb3416fa82f255420cc7af5, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/18048356dc1b4814be1ec13aa6352fc4, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/81b5e660c0334535a8902530ed70b3ee, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/3c7d81a2c1be4e2a96b09c572a7a2c69, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/c09bdd364441485fb89b12a94ac6da98_SeqId_44_] to archive 2023-02-13 17:55:06,872 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:55:06,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__8o4e0ifssoedhn86ekg1g85alif3pkif4ekqku7cvhr14k8u2916nla0qek3d6fk/family1/1d1a94a71d014dc0a7faa524986ed09f as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/1f3f7f84c2ed4679acd43a5bbc57ef0e_SeqId_47_ 2023-02-13 17:55:06,873 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(849): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__8o4e0ifssoedhn86ekg1g85alif3pkif4ekqku7cvhr14k8u2916nla0qek3d6fk/family1/1d1a94a71d014dc0a7faa524986ed09f into 31ed0c2af7cdd1dd637af92056b0a735/family1 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/1f3f7f84c2ed4679acd43a5bbc57ef0e_SeqId_47_ - updating store file list. 2023-02-13 17:55:06,874 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/6c010e1a4ab54bf2a069b1dca240dfaa to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/6c010e1a4ab54bf2a069b1dca240dfaa 2023-02-13 17:55:06,875 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/2d79a8bcba344ff295f441fb5fc8a4da to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/2d79a8bcba344ff295f441fb5fc8a4da 2023-02-13 17:55:06,877 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/5dd80c500fbd4b1593ed3b93ddd210c0 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/5dd80c500fbd4b1593ed3b93ddd210c0 2023-02-13 17:55:06,877 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(882): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/1f3f7f84c2ed4679acd43a5bbc57ef0e_SeqId_47_ into 31ed0c2af7cdd1dd637af92056b0a735/family1 2023-02-13 17:55:06,878 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(855): Successfully loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__8o4e0ifssoedhn86ekg1g85alif3pkif4ekqku7cvhr14k8u2916nla0qek3d6fk/family1/1d1a94a71d014dc0a7faa524986ed09f into 31ed0c2af7cdd1dd637af92056b0a735/family1 (new location: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/1f3f7f84c2ed4679acd43a5bbc57ef0e_SeqId_47_) 2023-02-13 17:55:06,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__8o4e0ifssoedhn86ekg1g85alif3pkif4ekqku7cvhr14k8u2916nla0qek3d6fk/family1/1d1a94a71d014dc0a7faa524986ed09f 2023-02-13 17:55:06,878 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/b02f8cb00ee043928ad3ead2abf47521 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/b02f8cb00ee043928ad3ead2abf47521 2023-02-13 17:55:06,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-13 17:55:06,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 397422 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-13 17:55:06,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(1912): 31ed0c2af7cdd1dd637af92056b0a735/family1 is initiating minor compaction (all files) 2023-02-13 17:55:06,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@43ba5a54; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 17:55:06,880 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 31ed0c2af7cdd1dd637af92056b0a735/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735. 2023-02-13 17:55:06,880 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/dc1152b3332b46dcbfa1b0a3593c82bd, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/92a58b9906204bdf976bac5ee245579d, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/1f3f7f84c2ed4679acd43a5bbc57ef0e_SeqId_47_] into tmpdir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/.tmp, totalSize=388.1 K 2023-02-13 17:55:06,880 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/efbb2941b6f44257b7c78a1df9e37dc0 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/efbb2941b6f44257b7c78a1df9e37dc0 2023-02-13 17:55:06,880 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting dc1152b3332b46dcbfa1b0a3593c82bd, keycount=1000, bloomtype=ROW, size=190.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878841551 2023-02-13 17:55:06,881 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting 92a58b9906204bdf976bac5ee245579d, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621241551 2023-02-13 17:55:06,881 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-13 17:55:06,882 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting 1f3f7f84c2ed4679acd43a5bbc57ef0e_SeqId_47_, keycount=1002, bloomtype=ROW, size=190.9 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878841551 2023-02-13 17:55:06,882 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:55:06,883 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/6a78a2fa3fb3416fa82f255420cc7af5 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/6a78a2fa3fb3416fa82f255420cc7af5 2023-02-13 17:55:06,884 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130a541c75289a4490893650b2b777c4f09 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130a541c75289a4490893650b2b777c4f09 2023-02-13 17:55:06,885 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/18048356dc1b4814be1ec13aa6352fc4 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/18048356dc1b4814be1ec13aa6352fc4 2023-02-13 17:55:06,886 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201437d6acb03db4500834d8b905173a68c to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201437d6acb03db4500834d8b905173a68c 2023-02-13 17:55:06,887 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/81b5e660c0334535a8902530ed70b3ee to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/81b5e660c0334535a8902530ed70b3ee 2023-02-13 17:55:06,887 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205e6ac7d4e045a458a93aca5d3b4b18909 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205e6ac7d4e045a458a93aca5d3b4b18909 2023-02-13 17:55:06,888 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 3 expired mob files are deleted 2023-02-13 17:55:06,888 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-13 17:55:06,888 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/3c7d81a2c1be4e2a96b09c572a7a2c69 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/3c7d81a2c1be4e2a96b09c572a7a2c69 2023-02-13 17:55:06,888 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 17:55:06,888 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-13 17:55:06,888 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 17:55:06,890 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=58, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-13 17:55:06,891 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/c09bdd364441485fb89b12a94ac6da98_SeqId_44_ to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/c09bdd364441485fb89b12a94ac6da98_SeqId_44_ 2023-02-13 17:55:06,891 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=58, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 1.8050 sec 2023-02-13 17:55:06,900 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] throttle.PressureAwareThroughputController(145): 31ed0c2af7cdd1dd637af92056b0a735#family1#compaction#74 average throughput is 29.94 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 17:55:06,957 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.HMaster$12(2441): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-13 17:55:06,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure2.ProcedureExecutor(1029): Stored pid=59, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:07,366 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-02-13 17:55:07,367 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-02-13 17:55:07,367 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-02-13 17:55:07,369 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-02-13 17:55:07,371 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=31ed0c2af7cdd1dd637af92056b0a735, REOPEN/MOVE}] 2023-02-13 17:55:07,372 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=31ed0c2af7cdd1dd637af92056b0a735, REOPEN/MOVE 2023-02-13 17:55:07,372 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=31ed0c2af7cdd1dd637af92056b0a735, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:07,373 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676310907372"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676310907372"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676310907372"}]},"ts":"1676310907372"} 2023-02-13 17:55:07,374 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=62, ppid=61, state=RUNNABLE; CloseRegionProcedure 31ed0c2af7cdd1dd637af92056b0a735, server=jenkins-hbase4.apache.org,38881,1676310818035}] 2023-02-13 17:55:07,525 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 31ed0c2af7cdd1dd637af92056b0a735 2023-02-13 17:55:07,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 31ed0c2af7cdd1dd637af92056b0a735, disabling compactions & flushes 2023-02-13 17:55:07,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1857): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735. 2023-02-13 17:55:07,717 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/.tmp/family1/4d7686130df64c609adab69355fb691f as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/4d7686130df64c609adab69355fb691f 2023-02-13 17:55:07,721 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 31ed0c2af7cdd1dd637af92056b0a735/family1 of 31ed0c2af7cdd1dd637af92056b0a735 into 4d7686130df64c609adab69355fb691f(size=192.0 K), total size for store is 192.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 17:55:07,721 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 31ed0c2af7cdd1dd637af92056b0a735: 2023-02-13 17:55:07,721 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735. 2023-02-13 17:55:07,721 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735. 2023-02-13 17:55:07,721 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735. after waiting 0 ms 2023-02-13 17:55:07,721 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735., storeName=family1, fileCount=3, fileSize=388.1 K (190.5 K, 6.8 K, 190.9 K), priority=2, time=1676310906879; duration=0sec 2023-02-13 17:55:07,721 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735. 2023-02-13 17:55:07,721 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 17:55:07,724 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/dc1152b3332b46dcbfa1b0a3593c82bd, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/92a58b9906204bdf976bac5ee245579d, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/1f3f7f84c2ed4679acd43a5bbc57ef0e_SeqId_47_] to archive 2023-02-13 17:55:07,725 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:55:07,726 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/dc1152b3332b46dcbfa1b0a3593c82bd to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/dc1152b3332b46dcbfa1b0a3593c82bd 2023-02-13 17:55:07,727 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/92a58b9906204bdf976bac5ee245579d to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/92a58b9906204bdf976bac5ee245579d 2023-02-13 17:55:07,728 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/1f3f7f84c2ed4679acd43a5bbc57ef0e_SeqId_47_ to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/1f3f7f84c2ed4679acd43a5bbc57ef0e_SeqId_47_ 2023-02-13 17:55:07,732 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-13 17:55:07,733 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735. 2023-02-13 17:55:07,733 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 31ed0c2af7cdd1dd637af92056b0a735: Waiting for close lock at 1676310907526Running coprocessor pre-close hooks at 1676310907526Disabling compacts and flushes for region at 1676310907526Disabling writes for close at 1676310907721 (+195 ms)Writing region close event to WAL at 1676310907730 (+9 ms)Running coprocessor post-close hooks at 1676310907732 (+2 ms)Closed at 1676310907733 (+1 ms) 2023-02-13 17:55:07,733 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 31ed0c2af7cdd1dd637af92056b0a735 to self. 2023-02-13 17:55:07,734 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 31ed0c2af7cdd1dd637af92056b0a735 2023-02-13 17:55:07,734 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=31ed0c2af7cdd1dd637af92056b0a735, regionState=CLOSED 2023-02-13 17:55:07,734 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676310907734"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676310907734"}]},"ts":"1676310907734"} 2023-02-13 17:55:07,736 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=62, resume processing ppid=61 2023-02-13 17:55:07,737 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=62, ppid=61, state=SUCCESS; CloseRegionProcedure 31ed0c2af7cdd1dd637af92056b0a735, server=jenkins-hbase4.apache.org,38881,1676310818035 in 361 msec 2023-02-13 17:55:07,737 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=31ed0c2af7cdd1dd637af92056b0a735, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,38881,1676310818035; forceNewPlan=false, retain=true 2023-02-13 17:55:07,887 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=31ed0c2af7cdd1dd637af92056b0a735, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:07,888 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676310907887"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676310907887"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676310907887"}]},"ts":"1676310907887"} 2023-02-13 17:55:07,889 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=63, ppid=61, state=RUNNABLE; OpenRegionProcedure 31ed0c2af7cdd1dd637af92056b0a735, server=jenkins-hbase4.apache.org,38881,1676310818035}] 2023-02-13 17:55:08,043 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735. 2023-02-13 17:55:08,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 31ed0c2af7cdd1dd637af92056b0a735, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735.', STARTKEY => '', ENDKEY => ''} 2023-02-13 17:55:08,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 31ed0c2af7cdd1dd637af92056b0a735 2023-02-13 17:55:08,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 17:55:08,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 31ed0c2af7cdd1dd637af92056b0a735 2023-02-13 17:55:08,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 31ed0c2af7cdd1dd637af92056b0a735 2023-02-13 17:55:08,045 INFO [StoreOpener-31ed0c2af7cdd1dd637af92056b0a735-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 31ed0c2af7cdd1dd637af92056b0a735 2023-02-13 17:55:08,045 DEBUG [StoreOpener-31ed0c2af7cdd1dd637af92056b0a735-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1 2023-02-13 17:55:08,045 DEBUG [StoreOpener-31ed0c2af7cdd1dd637af92056b0a735-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1 2023-02-13 17:55:08,046 INFO [StoreOpener-31ed0c2af7cdd1dd637af92056b0a735-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 31ed0c2af7cdd1dd637af92056b0a735 columnFamilyName family1 2023-02-13 17:55:08,050 DEBUG [StoreOpener-31ed0c2af7cdd1dd637af92056b0a735-1] regionserver.HStore(539): loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/4d7686130df64c609adab69355fb691f 2023-02-13 17:55:08,050 INFO [StoreOpener-31ed0c2af7cdd1dd637af92056b0a735-1] regionserver.HStore(310): Store=31ed0c2af7cdd1dd637af92056b0a735/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 17:55:08,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735 2023-02-13 17:55:08,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735 2023-02-13 17:55:08,054 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 31ed0c2af7cdd1dd637af92056b0a735 2023-02-13 17:55:08,055 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 31ed0c2af7cdd1dd637af92056b0a735; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60287630, jitterRate=-0.10164430737495422}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 17:55:08,055 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 31ed0c2af7cdd1dd637af92056b0a735: Running coprocessor pre-open hook at 1676310908044Writing region info on filesystem at 1676310908044Initializing all the Stores at 1676310908044Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1676310908044Cleaning up temporary data from old regions at 1676310908052 (+8 ms)Cleaning up detritus from prior splits at 1676310908053 (+1 ms)Running coprocessor post-open hooks at 1676310908055 (+2 ms)Region opened successfully at 1676310908055 2023-02-13 17:55:08,056 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735., pid=63, masterSystemTime=1676310908040 2023-02-13 17:55:08,057 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735. 2023-02-13 17:55:08,057 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735. 2023-02-13 17:55:08,057 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=31ed0c2af7cdd1dd637af92056b0a735, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:08,057 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676310908057"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676310908057"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676310908057"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676310908057"}]},"ts":"1676310908057"} 2023-02-13 17:55:08,059 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=63, resume processing ppid=61 2023-02-13 17:55:08,059 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=63, ppid=61, state=SUCCESS; OpenRegionProcedure 31ed0c2af7cdd1dd637af92056b0a735, server=jenkins-hbase4.apache.org,38881,1676310818035 in 169 msec 2023-02-13 17:55:08,060 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=60 2023-02-13 17:55:08,060 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=60, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=31ed0c2af7cdd1dd637af92056b0a735, REOPEN/MOVE in 688 msec 2023-02-13 17:55:08,062 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-02-13 17:55:08,062 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 692 msec 2023-02-13 17:55:08,064 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=59, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1060 sec 2023-02-13 17:55:08,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=59 2023-02-13 17:55:08,065 INFO [Listener at localhost/35343] compactions.TestMobCompactor(278): alter status finished 2023-02-13 17:55:08,066 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41433] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:08,067 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-13 17:55:08,068 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-13 17:55:08,068 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 17:55:08,068 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676311508068 2023-02-13 17:55:08,069 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-13 17:55:08,069 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-02-13 17:55:08,069 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-13 17:55:08,070 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] zookeeper.ReadOnlyZKClient(139): Connect 0x4259c9a6 to 127.0.0.1:64825 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 17:55:08,074 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7c44438f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 17:55:08,074 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 17:55:08,074 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 17:55:08,074 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 17:55:08,074 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 17:55:08,074 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 17:55:08,897 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128bbd7b6c73c9340a3ac5909e3b7d3fdcf to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128bbd7b6c73c9340a3ac5909e3b7d3fdcf 2023-02-13 17:55:08,898 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-13 17:55:08,916 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 17:55:08,917 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55648, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 17:55:08,924 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 17:55:08,926 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50214, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 17:55:08,935 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/d3e4d17b611b4b3eb4316800d3c5fc3a first=Optional[r05] last=Optional[r8] 2023-02-13 17:55:08,936 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735., hostname=jenkins-hbase4.apache.org,38881,1676310818035, seqNum=51 for row with hfile group [{family1,hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/d3e4d17b611b4b3eb4316800d3c5fc3a}] 2023-02-13 17:55:08,939 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(763): Validating hfile at hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/d3e4d17b611b4b3eb4316800d3c5fc3a for inclusion in 31ed0c2af7cdd1dd637af92056b0a735/family1 2023-02-13 17:55:08,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-02-13 17:55:08,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 17:55:08,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegion(2445): Flush status journal for 31ed0c2af7cdd1dd637af92056b0a735: 2023-02-13 17:55:08,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/d3e4d17b611b4b3eb4316800d3c5fc3a to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__jphk40m9gpn5fcisd8t87omgl5g69gh8kfpehnstl7ppum97erk0o05mhv5eum85/family1/d3e4d17b611b4b3eb4316800d3c5fc3a 2023-02-13 17:55:08,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__jphk40m9gpn5fcisd8t87omgl5g69gh8kfpehnstl7ppum97erk0o05mhv5eum85/family1/d3e4d17b611b4b3eb4316800d3c5fc3a as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/f428a291cd404398be6623e9519eb721_SeqId_53_ 2023-02-13 17:55:08,945 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(849): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__jphk40m9gpn5fcisd8t87omgl5g69gh8kfpehnstl7ppum97erk0o05mhv5eum85/family1/d3e4d17b611b4b3eb4316800d3c5fc3a into 31ed0c2af7cdd1dd637af92056b0a735/family1 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/f428a291cd404398be6623e9519eb721_SeqId_53_ - updating store file list. 2023-02-13 17:55:08,948 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(882): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/f428a291cd404398be6623e9519eb721_SeqId_53_ into 31ed0c2af7cdd1dd637af92056b0a735/family1 2023-02-13 17:55:08,948 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(855): Successfully loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__jphk40m9gpn5fcisd8t87omgl5g69gh8kfpehnstl7ppum97erk0o05mhv5eum85/family1/d3e4d17b611b4b3eb4316800d3c5fc3a into 31ed0c2af7cdd1dd637af92056b0a735/family1 (new location: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/f428a291cd404398be6623e9519eb721_SeqId_53_) 2023-02-13 17:55:08,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__jphk40m9gpn5fcisd8t87omgl5g69gh8kfpehnstl7ppum97erk0o05mhv5eum85/family1/d3e4d17b611b4b3eb4316800d3c5fc3a 2023-02-13 17:55:08,950 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-13 17:55:08,950 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:55:08,952 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112083db0fcbcf8b44828423f9cbfde5a465 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112083db0fcbcf8b44828423f9cbfde5a465 2023-02-13 17:55:08,953 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112897d135120ffe45a6a85a759076fe232e to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112897d135120ffe45a6a85a759076fe232e 2023-02-13 17:55:08,953 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2 expired mob files are deleted 2023-02-13 17:55:08,953 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-13 17:55:08,953 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 17:55:08,953 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 17:55:08,953 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 17:55:08,953 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-13 17:55:08,953 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 17:55:08,954 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-13 17:55:08,955 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 887 msec 2023-02-13 17:55:08,997 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.HMaster$12(2441): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} 2023-02-13 17:55:08,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:09,405 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-02-13 17:55:09,406 DEBUG [PEWorker-3] util.FSTableDescriptors(519): Deleted hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-02-13 17:55:09,406 INFO [PEWorker-3] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-02-13 17:55:09,408 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-02-13 17:55:09,410 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=31ed0c2af7cdd1dd637af92056b0a735, REOPEN/MOVE}] 2023-02-13 17:55:09,411 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=31ed0c2af7cdd1dd637af92056b0a735, REOPEN/MOVE 2023-02-13 17:55:09,411 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=31ed0c2af7cdd1dd637af92056b0a735, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:09,412 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676310909411"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676310909411"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676310909411"}]},"ts":"1676310909411"} 2023-02-13 17:55:09,413 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; CloseRegionProcedure 31ed0c2af7cdd1dd637af92056b0a735, server=jenkins-hbase4.apache.org,38881,1676310818035}] 2023-02-13 17:55:09,564 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 31ed0c2af7cdd1dd637af92056b0a735 2023-02-13 17:55:09,564 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 31ed0c2af7cdd1dd637af92056b0a735, disabling compactions & flushes 2023-02-13 17:55:09,564 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735. 2023-02-13 17:55:09,564 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735. 2023-02-13 17:55:09,564 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735. after waiting 0 ms 2023-02-13 17:55:09,564 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735. 2023-02-13 17:55:09,571 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-02-13 17:55:09,571 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735. 2023-02-13 17:55:09,571 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 31ed0c2af7cdd1dd637af92056b0a735: Waiting for close lock at 1676310909564Running coprocessor pre-close hooks at 1676310909564Disabling compacts and flushes for region at 1676310909564Disabling writes for close at 1676310909564Writing region close event to WAL at 1676310909568 (+4 ms)Running coprocessor post-close hooks at 1676310909571 (+3 ms)Closed at 1676310909571 2023-02-13 17:55:09,571 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 31ed0c2af7cdd1dd637af92056b0a735 to self. 2023-02-13 17:55:09,573 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 31ed0c2af7cdd1dd637af92056b0a735 2023-02-13 17:55:09,573 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=31ed0c2af7cdd1dd637af92056b0a735, regionState=CLOSED 2023-02-13 17:55:09,573 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676310909573"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676310909573"}]},"ts":"1676310909573"} 2023-02-13 17:55:09,575 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=67 2023-02-13 17:55:09,575 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=67, state=SUCCESS; CloseRegionProcedure 31ed0c2af7cdd1dd637af92056b0a735, server=jenkins-hbase4.apache.org,38881,1676310818035 in 161 msec 2023-02-13 17:55:09,575 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=31ed0c2af7cdd1dd637af92056b0a735, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,38881,1676310818035; forceNewPlan=false, retain=true 2023-02-13 17:55:09,726 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=31ed0c2af7cdd1dd637af92056b0a735, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:09,726 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676310909726"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676310909726"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676310909726"}]},"ts":"1676310909726"} 2023-02-13 17:55:09,728 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 31ed0c2af7cdd1dd637af92056b0a735, server=jenkins-hbase4.apache.org,38881,1676310818035}] 2023-02-13 17:55:09,882 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735. 2023-02-13 17:55:09,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 31ed0c2af7cdd1dd637af92056b0a735, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735.', STARTKEY => '', ENDKEY => ''} 2023-02-13 17:55:09,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 31ed0c2af7cdd1dd637af92056b0a735 2023-02-13 17:55:09,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 17:55:09,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 31ed0c2af7cdd1dd637af92056b0a735 2023-02-13 17:55:09,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 31ed0c2af7cdd1dd637af92056b0a735 2023-02-13 17:55:09,883 INFO [StoreOpener-31ed0c2af7cdd1dd637af92056b0a735-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 31ed0c2af7cdd1dd637af92056b0a735 2023-02-13 17:55:09,884 DEBUG [StoreOpener-31ed0c2af7cdd1dd637af92056b0a735-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1 2023-02-13 17:55:09,884 DEBUG [StoreOpener-31ed0c2af7cdd1dd637af92056b0a735-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1 2023-02-13 17:55:09,884 INFO [StoreOpener-31ed0c2af7cdd1dd637af92056b0a735-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 31ed0c2af7cdd1dd637af92056b0a735 columnFamilyName family1 2023-02-13 17:55:09,889 DEBUG [StoreOpener-31ed0c2af7cdd1dd637af92056b0a735-1] regionserver.HStore(539): loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/4d7686130df64c609adab69355fb691f 2023-02-13 17:55:09,891 DEBUG [StoreOpener-31ed0c2af7cdd1dd637af92056b0a735-1] regionserver.HStore(539): loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/family1/f428a291cd404398be6623e9519eb721_SeqId_53_ 2023-02-13 17:55:09,892 INFO [StoreOpener-31ed0c2af7cdd1dd637af92056b0a735-1] regionserver.HStore(310): Store=31ed0c2af7cdd1dd637af92056b0a735/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 17:55:09,892 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735 2023-02-13 17:55:09,893 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735 2023-02-13 17:55:09,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 31ed0c2af7cdd1dd637af92056b0a735 2023-02-13 17:55:09,896 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 31ed0c2af7cdd1dd637af92056b0a735; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60420946, jitterRate=-0.09965774416923523}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 17:55:09,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 31ed0c2af7cdd1dd637af92056b0a735: Running coprocessor pre-open hook at 1676310909882Writing region info on filesystem at 1676310909882Initializing all the Stores at 1676310909883 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} at 1676310909883Cleaning up temporary data from old regions at 1676310909894 (+11 ms)Cleaning up detritus from prior splits at 1676310909894Running coprocessor post-open hooks at 1676310909896 (+2 ms)Region opened successfully at 1676310909896 2023-02-13 17:55:09,897 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735., pid=69, masterSystemTime=1676310909879 2023-02-13 17:55:09,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735. 2023-02-13 17:55:09,898 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735. 2023-02-13 17:55:09,898 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=31ed0c2af7cdd1dd637af92056b0a735, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:09,898 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676310909898"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676310909898"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676310909898"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676310909898"}]},"ts":"1676310909898"} 2023-02-13 17:55:09,901 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-02-13 17:55:09,901 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 31ed0c2af7cdd1dd637af92056b0a735, server=jenkins-hbase4.apache.org,38881,1676310818035 in 172 msec 2023-02-13 17:55:09,902 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-02-13 17:55:09,902 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=31ed0c2af7cdd1dd637af92056b0a735, REOPEN/MOVE in 491 msec 2023-02-13 17:55:09,903 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=66, resume processing ppid=65 2023-02-13 17:55:09,903 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=66, ppid=65, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 494 msec 2023-02-13 17:55:09,904 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 906 msec 2023-02-13 17:55:09,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=65 2023-02-13 17:55:09,906 INFO [Listener at localhost/35343] compactions.TestMobCompactor(278): alter status finished 2023-02-13 17:55:09,907 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41433] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 17:55:09,908 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] procedure2.ProcedureExecutor(1029): Stored pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-13 17:55:09,908 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-13 17:55:09,909 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 17:55:09,909 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=70, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676311509909 2023-02-13 17:55:09,909 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-13 17:55:09,910 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-02-13 17:55:09,910 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-13 17:55:09,911 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] zookeeper.ReadOnlyZKClient(139): Connect 0x142e346d to 127.0.0.1:64825 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 17:55:09,914 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@69e121c9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 17:55:09,915 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 17:55:09,915 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 17:55:09,915 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 17:55:09,915 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 17:55:09,915 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 17:55:09,915 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 17:55:09,915 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 17:55:09,915 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 17:55:09,915 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-13 17:55:09,915 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 17:55:09,915 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=70, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-13 17:55:09,916 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=70, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 9 msec 2023-02-13 17:55:09,959 INFO [Listener at localhost/35343] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=239 (was 249), OpenFileDescriptor=609 (was 622), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=150 (was 200), ProcessCount=168 (was 168), AvailableMemoryMB=975 (was 1053) 2023-02-13 17:55:09,970 INFO [Listener at localhost/35343] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=239, OpenFileDescriptor=609, MaxFileDescriptor=60000, SystemLoadAverage=150, ProcessCount=168, AvailableMemoryMB=974 2023-02-13 17:55:09,973 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-13 17:55:09,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testGetAfterCompaction 2023-02-13 17:55:09,975 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 17:55:09,975 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testGetAfterCompaction" procId is: 71 2023-02-13 17:55:09,976 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 17:55:09,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-13 17:55:09,977 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746 2023-02-13 17:55:09,977 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746 empty. 2023-02-13 17:55:09,977 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746 2023-02-13 17:55:09,977 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-02-13 17:55:10,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-13 17:55:10,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-13 17:55:10,385 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testGetAfterCompaction/.tabledesc/.tableinfo.0000000001 2023-02-13 17:55:10,386 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(7671): creating {ENCODED => 2b583a2a91797baaacc08ea86fce6746, NAME => 'testGetAfterCompaction,,1676310909973.2b583a2a91797baaacc08ea86fce6746.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp 2023-02-13 17:55:10,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-13 17:55:10,792 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(865): Instantiated testGetAfterCompaction,,1676310909973.2b583a2a91797baaacc08ea86fce6746.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 17:55:10,792 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1603): Closing 2b583a2a91797baaacc08ea86fce6746, disabling compactions & flushes 2023-02-13 17:55:10,792 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1625): Closing region testGetAfterCompaction,,1676310909973.2b583a2a91797baaacc08ea86fce6746. 2023-02-13 17:55:10,792 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testGetAfterCompaction,,1676310909973.2b583a2a91797baaacc08ea86fce6746. 2023-02-13 17:55:10,792 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1713): Acquired close lock on testGetAfterCompaction,,1676310909973.2b583a2a91797baaacc08ea86fce6746. after waiting 0 ms 2023-02-13 17:55:10,792 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1723): Updates disabled for region testGetAfterCompaction,,1676310909973.2b583a2a91797baaacc08ea86fce6746. 2023-02-13 17:55:10,792 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1837): Closed testGetAfterCompaction,,1676310909973.2b583a2a91797baaacc08ea86fce6746. 2023-02-13 17:55:10,792 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1557): Region close journal for 2b583a2a91797baaacc08ea86fce6746: Waiting for close lock at 1676310910792Disabling compacts and flushes for region at 1676310910792Disabling writes for close at 1676310910792Writing region close event to WAL at 1676310910792Closed at 1676310910792 2023-02-13 17:55:10,794 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 17:55:10,795 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1676310909973.2b583a2a91797baaacc08ea86fce6746.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1676310910795"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676310910795"}]},"ts":"1676310910795"} 2023-02-13 17:55:10,796 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 17:55:10,797 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 17:55:10,797 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676310910797"}]},"ts":"1676310910797"} 2023-02-13 17:55:10,798 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLING in hbase:meta 2023-02-13 17:55:10,801 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=2b583a2a91797baaacc08ea86fce6746, ASSIGN}] 2023-02-13 17:55:10,802 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=2b583a2a91797baaacc08ea86fce6746, ASSIGN 2023-02-13 17:55:10,802 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testGetAfterCompaction, region=2b583a2a91797baaacc08ea86fce6746, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38881,1676310818035; forceNewPlan=false, retain=false 2023-02-13 17:55:10,953 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=2b583a2a91797baaacc08ea86fce6746, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:10,954 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1676310909973.2b583a2a91797baaacc08ea86fce6746.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1676310910953"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676310910953"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676310910953"}]},"ts":"1676310910953"} 2023-02-13 17:55:10,955 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=73, ppid=72, state=RUNNABLE; OpenRegionProcedure 2b583a2a91797baaacc08ea86fce6746, server=jenkins-hbase4.apache.org,38881,1676310818035}] 2023-02-13 17:55:11,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-13 17:55:11,108 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testGetAfterCompaction,,1676310909973.2b583a2a91797baaacc08ea86fce6746. 2023-02-13 17:55:11,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 2b583a2a91797baaacc08ea86fce6746, NAME => 'testGetAfterCompaction,,1676310909973.2b583a2a91797baaacc08ea86fce6746.', STARTKEY => '', ENDKEY => ''} 2023-02-13 17:55:11,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro with path null and priority 1073741823 2023-02-13 17:55:11,110 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro from HTD of testGetAfterCompaction successfully. 2023-02-13 17:55:11,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testGetAfterCompaction 2b583a2a91797baaacc08ea86fce6746 2023-02-13 17:55:11,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testGetAfterCompaction,,1676310909973.2b583a2a91797baaacc08ea86fce6746.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 17:55:11,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 2b583a2a91797baaacc08ea86fce6746 2023-02-13 17:55:11,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 2b583a2a91797baaacc08ea86fce6746 2023-02-13 17:55:11,112 INFO [StoreOpener-2b583a2a91797baaacc08ea86fce6746-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2b583a2a91797baaacc08ea86fce6746 2023-02-13 17:55:11,113 DEBUG [StoreOpener-2b583a2a91797baaacc08ea86fce6746-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1 2023-02-13 17:55:11,113 DEBUG [StoreOpener-2b583a2a91797baaacc08ea86fce6746-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1 2023-02-13 17:55:11,113 INFO [StoreOpener-2b583a2a91797baaacc08ea86fce6746-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2b583a2a91797baaacc08ea86fce6746 columnFamilyName f1 2023-02-13 17:55:11,115 INFO [StoreOpener-2b583a2a91797baaacc08ea86fce6746-1] regionserver.HStore(310): Store=2b583a2a91797baaacc08ea86fce6746/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 17:55:11,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746 2023-02-13 17:55:11,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746 2023-02-13 17:55:11,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 2b583a2a91797baaacc08ea86fce6746 2023-02-13 17:55:11,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 17:55:11,119 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 2b583a2a91797baaacc08ea86fce6746; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74326039, jitterRate=0.10754428803920746}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 17:55:11,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 2b583a2a91797baaacc08ea86fce6746: Running coprocessor pre-open hook at 1676310911111Writing region info on filesystem at 1676310911111Initializing all the Stores at 1676310911112 (+1 ms)Instantiating store for column family {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676310911112Cleaning up temporary data from old regions at 1676310911116 (+4 ms)Cleaning up detritus from prior splits at 1676310911116Running coprocessor post-open hooks at 1676310911119 (+3 ms)Region opened successfully at 1676310911119 2023-02-13 17:55:11,120 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testGetAfterCompaction,,1676310909973.2b583a2a91797baaacc08ea86fce6746., pid=73, masterSystemTime=1676310911106 2023-02-13 17:55:11,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testGetAfterCompaction,,1676310909973.2b583a2a91797baaacc08ea86fce6746. 2023-02-13 17:55:11,121 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testGetAfterCompaction,,1676310909973.2b583a2a91797baaacc08ea86fce6746. 2023-02-13 17:55:11,121 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=2b583a2a91797baaacc08ea86fce6746, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:11,122 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testGetAfterCompaction,,1676310909973.2b583a2a91797baaacc08ea86fce6746.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1676310911121"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676310911121"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676310911121"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676310911121"}]},"ts":"1676310911121"} 2023-02-13 17:55:11,124 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=72 2023-02-13 17:55:11,124 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=72, state=SUCCESS; OpenRegionProcedure 2b583a2a91797baaacc08ea86fce6746, server=jenkins-hbase4.apache.org,38881,1676310818035 in 168 msec 2023-02-13 17:55:11,125 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-02-13 17:55:11,125 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=2b583a2a91797baaacc08ea86fce6746, ASSIGN in 324 msec 2023-02-13 17:55:11,125 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 17:55:11,126 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676310911126"}]},"ts":"1676310911126"} 2023-02-13 17:55:11,126 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLED in hbase:meta 2023-02-13 17:55:11,128 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 17:55:11,129 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; CreateTableProcedure table=testGetAfterCompaction in 1.1550 sec 2023-02-13 17:55:12,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-13 17:55:12,081 INFO [Listener at localhost/35343] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testGetAfterCompaction, procId: 71 completed 2023-02-13 17:55:12,081 DEBUG [Listener at localhost/35343] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testGetAfterCompaction get assigned. Timeout = 60000ms 2023-02-13 17:55:12,083 INFO [Listener at localhost/35343] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 17:55:12,086 INFO [Listener at localhost/35343] hbase.HBaseTestingUtility(3484): All regions for table testGetAfterCompaction assigned to meta. Checking AM states. 2023-02-13 17:55:12,086 INFO [Listener at localhost/35343] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 17:55:12,086 INFO [Listener at localhost/35343] hbase.HBaseTestingUtility(3504): All regions for table testGetAfterCompaction assigned. 2023-02-13 17:55:12,090 INFO [Listener at localhost/35343] regionserver.HRegion(2744): Flushing 2b583a2a91797baaacc08ea86fce6746 1/1 column families, dataSize=37 B heapSize=368 B 2023-02-13 17:55:12,502 INFO [Listener at localhost/35343] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213bd1f6fab747243b6b15f5831627930d9 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230213bd1f6fab747243b6b15f5831627930d9 2023-02-13 17:55:12,508 INFO [Listener at localhost/35343] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/.tmp/f1/4345a153062e450dbef20a3b7cce51fb 2023-02-13 17:55:12,513 DEBUG [Listener at localhost/35343] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/.tmp/f1/4345a153062e450dbef20a3b7cce51fb as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/4345a153062e450dbef20a3b7cce51fb 2023-02-13 17:55:12,516 INFO [Listener at localhost/35343] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/4345a153062e450dbef20a3b7cce51fb, entries=1, sequenceid=5, filesize=4.9 K 2023-02-13 17:55:12,517 INFO [Listener at localhost/35343] regionserver.HRegion(2947): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 2b583a2a91797baaacc08ea86fce6746 in 427ms, sequenceid=5, compaction requested=false 2023-02-13 17:55:12,517 DEBUG [Listener at localhost/35343] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testGetAfterCompaction' 2023-02-13 17:55:12,517 DEBUG [Listener at localhost/35343] regionserver.HRegion(2445): Flush status journal for 2b583a2a91797baaacc08ea86fce6746: 2023-02-13 17:55:12,519 INFO [Listener at localhost/35343] regionserver.HRegion(2744): Flushing 2b583a2a91797baaacc08ea86fce6746 1/1 column families, dataSize=37 B heapSize=368 B 2023-02-13 17:55:12,928 INFO [Listener at localhost/35343] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213ae1e51fbd4684e50a8c412ab42d96221 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230213ae1e51fbd4684e50a8c412ab42d96221 2023-02-13 17:55:13,277 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 17:55:13,333 INFO [Listener at localhost/35343] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/.tmp/f1/12eccf6c12704697b1e22779fcb0171d 2023-02-13 17:55:13,338 DEBUG [Listener at localhost/35343] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/.tmp/f1/12eccf6c12704697b1e22779fcb0171d as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/12eccf6c12704697b1e22779fcb0171d 2023-02-13 17:55:13,342 INFO [Listener at localhost/35343] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/12eccf6c12704697b1e22779fcb0171d, entries=1, sequenceid=9, filesize=4.9 K 2023-02-13 17:55:13,343 INFO [Listener at localhost/35343] regionserver.HRegion(2947): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 2b583a2a91797baaacc08ea86fce6746 in 824ms, sequenceid=9, compaction requested=false 2023-02-13 17:55:13,343 DEBUG [Listener at localhost/35343] regionserver.HRegion(2445): Flush status journal for 2b583a2a91797baaacc08ea86fce6746: 2023-02-13 17:55:13,344 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41433] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testGetAfterCompaction 2023-02-13 17:55:13,345 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] procedure2.ProcedureExecutor(1029): Stored pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-02-13 17:55:13,346 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-02-13 17:55:13,347 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] mob.MobUtils(833): start MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 17:55:13,347 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=74, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676311513347 2023-02-13 17:55:13,347 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-13 17:55:13,347 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testGetAfterCompaction' and column 'f1' 2023-02-13 17:55:13,347 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testGetAfterCompaction' column='f1' 2023-02-13 17:55:13,348 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] zookeeper.ReadOnlyZKClient(139): Connect 0x61038378 to 127.0.0.1:64825 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 17:55:13,355 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@10c09f8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 17:55:13,355 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230213 for table='testGetAfterCompaction' and column='f1' 2023-02-13 17:55:13,395 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/12eccf6c12704697b1e22779fcb0171d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310913333; access_time=1676310912520; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:13,395 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/4345a153062e450dbef20a3b7cce51fb; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310912508; access_time=1676310912093; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:13,446 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/12eccf6c12704697b1e22779fcb0171d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310913333; access_time=1676310912520; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:13,446 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/4345a153062e450dbef20a3b7cce51fb; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310912508; access_time=1676310912093; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:13,497 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/12eccf6c12704697b1e22779fcb0171d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310913333; access_time=1676310912520; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:13,497 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/4345a153062e450dbef20a3b7cce51fb; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310912508; access_time=1676310912093; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:13,548 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/12eccf6c12704697b1e22779fcb0171d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310913333; access_time=1676310912520; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:13,548 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/4345a153062e450dbef20a3b7cce51fb; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310912508; access_time=1676310912093; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:13,599 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/12eccf6c12704697b1e22779fcb0171d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310913333; access_time=1676310912520; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:13,599 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/4345a153062e450dbef20a3b7cce51fb; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310912508; access_time=1676310912093; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:13,649 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/12eccf6c12704697b1e22779fcb0171d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310913333; access_time=1676310912520; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:13,650 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/4345a153062e450dbef20a3b7cce51fb; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310912508; access_time=1676310912093; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:13,700 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/12eccf6c12704697b1e22779fcb0171d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310913333; access_time=1676310912520; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:13,700 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/4345a153062e450dbef20a3b7cce51fb; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310912508; access_time=1676310912093; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:13,751 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/12eccf6c12704697b1e22779fcb0171d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310913333; access_time=1676310912520; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:13,751 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/4345a153062e450dbef20a3b7cce51fb; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310912508; access_time=1676310912093; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:13,802 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/12eccf6c12704697b1e22779fcb0171d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310913333; access_time=1676310912520; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:13,802 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/4345a153062e450dbef20a3b7cce51fb; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310912508; access_time=1676310912093; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:13,852 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/12eccf6c12704697b1e22779fcb0171d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310913333; access_time=1676310912520; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:13,853 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/4345a153062e450dbef20a3b7cce51fb; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310912508; access_time=1676310912093; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:13,903 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/12eccf6c12704697b1e22779fcb0171d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310913333; access_time=1676310912520; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:13,903 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/4345a153062e450dbef20a3b7cce51fb; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310912508; access_time=1676310912093; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:13,954 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/12eccf6c12704697b1e22779fcb0171d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310913333; access_time=1676310912520; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:13,954 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/4345a153062e450dbef20a3b7cce51fb; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310912508; access_time=1676310912093; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:14,005 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/12eccf6c12704697b1e22779fcb0171d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310913333; access_time=1676310912520; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:14,005 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/4345a153062e450dbef20a3b7cce51fb; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310912508; access_time=1676310912093; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:14,056 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/12eccf6c12704697b1e22779fcb0171d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310913333; access_time=1676310912520; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:14,056 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/4345a153062e450dbef20a3b7cce51fb; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310912508; access_time=1676310912093; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:14,107 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/12eccf6c12704697b1e22779fcb0171d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310913333; access_time=1676310912520; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:14,107 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/4345a153062e450dbef20a3b7cce51fb; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310912508; access_time=1676310912093; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:14,157 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/12eccf6c12704697b1e22779fcb0171d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310913333; access_time=1676310912520; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:14,158 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/4345a153062e450dbef20a3b7cce51fb; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310912508; access_time=1676310912093; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:14,179 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213462a1c1332d24fd9b8626855023e3c85 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230213462a1c1332d24fd9b8626855023e3c85 2023-02-13 17:55:14,179 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230213 table='testGetAfterCompaction' column='f1' 2023-02-13 17:55:14,191 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 17:55:14,193 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41430, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 17:55:14,198 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 17:55:14,200 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60092, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 17:55:14,208 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230213/f1/b88bf2aeb9af4536af3aaf514b2bb118 first=Optional[r1] last=Optional[r2] 2023-02-13 17:55:14,208 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/12eccf6c12704697b1e22779fcb0171d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310913333; access_time=1676310912520; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:14,208 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testGetAfterCompaction,,1676310909973.2b583a2a91797baaacc08ea86fce6746., hostname=jenkins-hbase4.apache.org,38881,1676310818035, seqNum=2 for row with hfile group [{f1,hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230213/f1/b88bf2aeb9af4536af3aaf514b2bb118}] 2023-02-13 17:55:14,209 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/4345a153062e450dbef20a3b7cce51fb; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310912508; access_time=1676310912093; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:14,212 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(763): Validating hfile at hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230213/f1/b88bf2aeb9af4536af3aaf514b2bb118 for inclusion in 2b583a2a91797baaacc08ea86fce6746/f1 2023-02-13 17:55:14,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-02-13 17:55:14,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 17:55:14,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegion(2445): Flush status journal for 2b583a2a91797baaacc08ea86fce6746: 2023-02-13 17:55:14,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230213/f1/b88bf2aeb9af4536af3aaf514b2bb118 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testGetAfterCompaction__83tq9v5ru5dpoge0ab9j9f71p16mtl90f05i29ubo6oj21c5qrttciberf5sefoa/f1/b88bf2aeb9af4536af3aaf514b2bb118 2023-02-13 17:55:14,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testGetAfterCompaction__83tq9v5ru5dpoge0ab9j9f71p16mtl90f05i29ubo6oj21c5qrttciberf5sefoa/f1/b88bf2aeb9af4536af3aaf514b2bb118 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/029b24bc03884cf4bdc0ad56ae7b39d5_SeqId_12_ 2023-02-13 17:55:14,217 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(849): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testGetAfterCompaction__83tq9v5ru5dpoge0ab9j9f71p16mtl90f05i29ubo6oj21c5qrttciberf5sefoa/f1/b88bf2aeb9af4536af3aaf514b2bb118 into 2b583a2a91797baaacc08ea86fce6746/f1 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/029b24bc03884cf4bdc0ad56ae7b39d5_SeqId_12_ - updating store file list. 2023-02-13 17:55:14,221 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(882): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/029b24bc03884cf4bdc0ad56ae7b39d5_SeqId_12_ into 2b583a2a91797baaacc08ea86fce6746/f1 2023-02-13 17:55:14,221 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(855): Successfully loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testGetAfterCompaction__83tq9v5ru5dpoge0ab9j9f71p16mtl90f05i29ubo6oj21c5qrttciberf5sefoa/f1/b88bf2aeb9af4536af3aaf514b2bb118 into 2b583a2a91797baaacc08ea86fce6746/f1 (new location: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/029b24bc03884cf4bdc0ad56ae7b39d5_SeqId_12_) 2023-02-13 17:55:14,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testGetAfterCompaction__83tq9v5ru5dpoge0ab9j9f71p16mtl90f05i29ubo6oj21c5qrttciberf5sefoa/f1/b88bf2aeb9af4536af3aaf514b2bb118 2023-02-13 17:55:14,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(1912): 2b583a2a91797baaacc08ea86fce6746/f1 is initiating minor compaction 2023-02-13 17:55:14,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5f86aad0; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 17:55:14,222 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 2b583a2a91797baaacc08ea86fce6746/f1 in testGetAfterCompaction,,1676310909973.2b583a2a91797baaacc08ea86fce6746. 2023-02-13 17:55:14,222 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/12eccf6c12704697b1e22779fcb0171d, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/029b24bc03884cf4bdc0ad56ae7b39d5_SeqId_12_] into tmpdir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/.tmp, totalSize=10.0 K 2023-02-13 17:55:14,222 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting 12eccf6c12704697b1e22779fcb0171d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-13 17:55:14,223 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting 029b24bc03884cf4bdc0ad56ae7b39d5_SeqId_12_, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-13 17:55:14,225 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230213 table='testGetAfterCompaction' column='f1' 2023-02-13 17:55:14,226 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:55:14,227 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230213ae1e51fbd4684e50a8c412ab42d96221 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230213ae1e51fbd4684e50a8c412ab42d96221 2023-02-13 17:55:14,229 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230213bd1f6fab747243b6b15f5831627930d9 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230213bd1f6fab747243b6b15f5831627930d9 2023-02-13 17:55:14,229 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testGetAfterCompaction 2 expired mob files are deleted 2023-02-13 17:55:14,229 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230213' 2023-02-13 17:55:14,229 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230213 for table='testGetAfterCompaction' and column='f1' 2023-02-13 17:55:14,229 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testGetAfterCompaction' column='f1' 2023-02-13 17:55:14,229 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] mob.MobUtils(840): end MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 17:55:14,230 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=74, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-02-13 17:55:14,231 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] throttle.PressureAwareThroughputController(145): 2b583a2a91797baaacc08ea86fce6746#f1#compaction#77 average throughput is 0.25 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 17:55:14,231 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=74, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE in 885 msec 2023-02-13 17:55:14,259 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/029b24bc03884cf4bdc0ad56ae7b39d5_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676310914175; access_time=1676310913366; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 17:55:14,259 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/12eccf6c12704697b1e22779fcb0171d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310913333; access_time=1676310912520; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:14,259 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/4345a153062e450dbef20a3b7cce51fb; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310912508; access_time=1676310912093; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:14,263 DEBUG [Listener at localhost/35343] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 17:55:14,267 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41440, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 17:55:14,267 INFO [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=38881] regionserver.RSRpcServices(1662): Compacting testGetAfterCompaction,,1676310909973.2b583a2a91797baaacc08ea86fce6746. 2023-02-13 17:55:14,267 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=38881] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 2 compacting, 0 eligible, 16 blocking 2023-02-13 17:55:14,267 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=38881] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-02-13 17:55:14,268 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=38881] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-02-13 17:55:14,268 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=38881] regionserver.CompactSplit(415): Not compacting testGetAfterCompaction,,1676310909973.2b583a2a91797baaacc08ea86fce6746. because compaction request was cancelled 2023-02-13 17:55:14,319 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/029b24bc03884cf4bdc0ad56ae7b39d5_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676310914175; access_time=1676310913366; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 17:55:14,320 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/12eccf6c12704697b1e22779fcb0171d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310913333; access_time=1676310912520; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:14,320 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/4345a153062e450dbef20a3b7cce51fb; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310912508; access_time=1676310912093; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:14,370 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/029b24bc03884cf4bdc0ad56ae7b39d5_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676310914175; access_time=1676310913366; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 17:55:14,370 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/12eccf6c12704697b1e22779fcb0171d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310913333; access_time=1676310912520; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:14,370 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/4345a153062e450dbef20a3b7cce51fb; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310912508; access_time=1676310912093; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:14,421 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/029b24bc03884cf4bdc0ad56ae7b39d5_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676310914175; access_time=1676310913366; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 17:55:14,421 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/12eccf6c12704697b1e22779fcb0171d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310913333; access_time=1676310912520; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:14,421 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/4345a153062e450dbef20a3b7cce51fb; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310912508; access_time=1676310912093; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:14,472 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/029b24bc03884cf4bdc0ad56ae7b39d5_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676310914175; access_time=1676310913366; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 17:55:14,472 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/12eccf6c12704697b1e22779fcb0171d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310913333; access_time=1676310912520; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:14,472 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/4345a153062e450dbef20a3b7cce51fb; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310912508; access_time=1676310912093; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:14,523 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/029b24bc03884cf4bdc0ad56ae7b39d5_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676310914175; access_time=1676310913366; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 17:55:14,523 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/12eccf6c12704697b1e22779fcb0171d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310913333; access_time=1676310912520; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:14,523 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/4345a153062e450dbef20a3b7cce51fb; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310912508; access_time=1676310912093; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:14,574 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/029b24bc03884cf4bdc0ad56ae7b39d5_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676310914175; access_time=1676310913366; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 17:55:14,574 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/12eccf6c12704697b1e22779fcb0171d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310913333; access_time=1676310912520; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:14,574 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/4345a153062e450dbef20a3b7cce51fb; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310912508; access_time=1676310912093; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:14,624 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/029b24bc03884cf4bdc0ad56ae7b39d5_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676310914175; access_time=1676310913366; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 17:55:14,624 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/12eccf6c12704697b1e22779fcb0171d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310913333; access_time=1676310912520; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:14,624 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/4345a153062e450dbef20a3b7cce51fb; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310912508; access_time=1676310912093; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:14,675 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/029b24bc03884cf4bdc0ad56ae7b39d5_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676310914175; access_time=1676310913366; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 17:55:14,675 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/12eccf6c12704697b1e22779fcb0171d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310913333; access_time=1676310912520; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:14,675 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/4345a153062e450dbef20a3b7cce51fb; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310912508; access_time=1676310912093; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:14,726 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/029b24bc03884cf4bdc0ad56ae7b39d5_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676310914175; access_time=1676310913366; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 17:55:14,726 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/12eccf6c12704697b1e22779fcb0171d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310913333; access_time=1676310912520; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:14,726 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/4345a153062e450dbef20a3b7cce51fb; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310912508; access_time=1676310912093; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:14,777 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/029b24bc03884cf4bdc0ad56ae7b39d5_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676310914175; access_time=1676310913366; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 17:55:14,777 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/12eccf6c12704697b1e22779fcb0171d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310913333; access_time=1676310912520; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:14,777 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/4345a153062e450dbef20a3b7cce51fb; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310912508; access_time=1676310912093; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:14,828 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/029b24bc03884cf4bdc0ad56ae7b39d5_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676310914175; access_time=1676310913366; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 17:55:14,828 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/12eccf6c12704697b1e22779fcb0171d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310913333; access_time=1676310912520; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:14,828 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/4345a153062e450dbef20a3b7cce51fb; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310912508; access_time=1676310912093; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:14,878 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/029b24bc03884cf4bdc0ad56ae7b39d5_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676310914175; access_time=1676310913366; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 17:55:14,879 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/12eccf6c12704697b1e22779fcb0171d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310913333; access_time=1676310912520; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:14,879 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/4345a153062e450dbef20a3b7cce51fb; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310912508; access_time=1676310912093; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:14,929 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/029b24bc03884cf4bdc0ad56ae7b39d5_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676310914175; access_time=1676310913366; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 17:55:14,929 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/12eccf6c12704697b1e22779fcb0171d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310913333; access_time=1676310912520; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:14,929 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/4345a153062e450dbef20a3b7cce51fb; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310912508; access_time=1676310912093; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:14,980 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/029b24bc03884cf4bdc0ad56ae7b39d5_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676310914175; access_time=1676310913366; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 17:55:14,980 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/12eccf6c12704697b1e22779fcb0171d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310913333; access_time=1676310912520; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:14,980 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/4345a153062e450dbef20a3b7cce51fb; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310912508; access_time=1676310912093; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:15,031 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/029b24bc03884cf4bdc0ad56ae7b39d5_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676310914175; access_time=1676310913366; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 17:55:15,031 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/12eccf6c12704697b1e22779fcb0171d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310913333; access_time=1676310912520; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:15,031 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/4345a153062e450dbef20a3b7cce51fb; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310912508; access_time=1676310912093; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:15,046 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/.tmp/f1/1291af1129cf4d03bfe39fefc065e162 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/1291af1129cf4d03bfe39fefc065e162 2023-02-13 17:55:15,050 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 2 file(s) in 2b583a2a91797baaacc08ea86fce6746/f1 of 2b583a2a91797baaacc08ea86fce6746 into 1291af1129cf4d03bfe39fefc065e162(size=5.1 K), total size for store is 10.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 17:55:15,051 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 2b583a2a91797baaacc08ea86fce6746: 2023-02-13 17:55:15,051 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testGetAfterCompaction,,1676310909973.2b583a2a91797baaacc08ea86fce6746., storeName=f1, fileCount=2, fileSize=10.0 K (4.9 K, 5.1 K), priority=2, time=1676310914222; duration=0sec 2023-02-13 17:55:15,051 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 17:55:15,062 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/12eccf6c12704697b1e22779fcb0171d, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/029b24bc03884cf4bdc0ad56ae7b39d5_SeqId_12_] to archive 2023-02-13 17:55:15,063 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:55:15,064 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/12eccf6c12704697b1e22779fcb0171d to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/12eccf6c12704697b1e22779fcb0171d 2023-02-13 17:55:15,065 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/029b24bc03884cf4bdc0ad56ae7b39d5_SeqId_12_ to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/029b24bc03884cf4bdc0ad56ae7b39d5_SeqId_12_ 2023-02-13 17:55:15,082 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/1291af1129cf4d03bfe39fefc065e162; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1676310915042; access_time=1676310914228; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:15,082 INFO [Listener at localhost/35343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/4345a153062e450dbef20a3b7cce51fb; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676310912508; access_time=1676310912093; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 17:55:15,197 INFO [Listener at localhost/35343] client.HBaseAdmin$15(890): Started disable of testGetAfterCompaction 2023-02-13 17:55:15,201 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testGetAfterCompaction 2023-02-13 17:55:15,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure2.ProcedureExecutor(1029): Stored pid=75, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testGetAfterCompaction 2023-02-13 17:55:15,212 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676310915212"}]},"ts":"1676310915212"} 2023-02-13 17:55:15,213 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLING in hbase:meta 2023-02-13 17:55:15,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-02-13 17:55:15,215 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testGetAfterCompaction to state=DISABLING 2023-02-13 17:55:15,216 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=2b583a2a91797baaacc08ea86fce6746, UNASSIGN}] 2023-02-13 17:55:15,217 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=2b583a2a91797baaacc08ea86fce6746, UNASSIGN 2023-02-13 17:55:15,217 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=2b583a2a91797baaacc08ea86fce6746, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:15,218 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1676310909973.2b583a2a91797baaacc08ea86fce6746.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1676310915217"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676310915217"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676310915217"}]},"ts":"1676310915217"} 2023-02-13 17:55:15,219 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; CloseRegionProcedure 2b583a2a91797baaacc08ea86fce6746, server=jenkins-hbase4.apache.org,38881,1676310818035}] 2023-02-13 17:55:15,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-02-13 17:55:15,370 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 2b583a2a91797baaacc08ea86fce6746 2023-02-13 17:55:15,370 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 2b583a2a91797baaacc08ea86fce6746, disabling compactions & flushes 2023-02-13 17:55:15,370 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testGetAfterCompaction,,1676310909973.2b583a2a91797baaacc08ea86fce6746. 2023-02-13 17:55:15,370 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testGetAfterCompaction,,1676310909973.2b583a2a91797baaacc08ea86fce6746. 2023-02-13 17:55:15,370 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testGetAfterCompaction,,1676310909973.2b583a2a91797baaacc08ea86fce6746. after waiting 0 ms 2023-02-13 17:55:15,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testGetAfterCompaction,,1676310909973.2b583a2a91797baaacc08ea86fce6746. 2023-02-13 17:55:15,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-02-13 17:55:15,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-02-13 17:55:15,376 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testGetAfterCompaction,,1676310909973.2b583a2a91797baaacc08ea86fce6746. 2023-02-13 17:55:15,376 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 2b583a2a91797baaacc08ea86fce6746: Waiting for close lock at 1676310915370Running coprocessor pre-close hooks at 1676310915370Disabling compacts and flushes for region at 1676310915370Disabling writes for close at 1676310915371 (+1 ms)Writing region close event to WAL at 1676310915371Running coprocessor post-close hooks at 1676310915374 (+3 ms)Closed at 1676310915376 (+2 ms) 2023-02-13 17:55:15,377 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 2b583a2a91797baaacc08ea86fce6746 2023-02-13 17:55:15,377 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=2b583a2a91797baaacc08ea86fce6746, regionState=CLOSED 2023-02-13 17:55:15,377 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1676310909973.2b583a2a91797baaacc08ea86fce6746.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1676310915377"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676310915377"}]},"ts":"1676310915377"} 2023-02-13 17:55:15,379 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-02-13 17:55:15,379 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; CloseRegionProcedure 2b583a2a91797baaacc08ea86fce6746, server=jenkins-hbase4.apache.org,38881,1676310818035 in 159 msec 2023-02-13 17:55:15,380 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=75 2023-02-13 17:55:15,380 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=75, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=2b583a2a91797baaacc08ea86fce6746, UNASSIGN in 163 msec 2023-02-13 17:55:15,381 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676310915381"}]},"ts":"1676310915381"} 2023-02-13 17:55:15,381 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLED in hbase:meta 2023-02-13 17:55:15,386 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testGetAfterCompaction to state=DISABLED 2023-02-13 17:55:15,387 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=75, state=SUCCESS; DisableTableProcedure table=testGetAfterCompaction in 183 msec 2023-02-13 17:55:15,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-02-13 17:55:15,516 INFO [Listener at localhost/35343] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testGetAfterCompaction, procId: 75 completed 2023-02-13 17:55:15,520 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testGetAfterCompaction 2023-02-13 17:55:15,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testGetAfterCompaction 2023-02-13 17:55:15,527 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-13 17:55:15,528 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=78, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-13 17:55:15,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=78 2023-02-13 17:55:15,531 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746 2023-02-13 17:55:15,533 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1, FileablePath, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/recovered.edits] 2023-02-13 17:55:15,537 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/1291af1129cf4d03bfe39fefc065e162 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/1291af1129cf4d03bfe39fefc065e162 2023-02-13 17:55:15,538 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/4345a153062e450dbef20a3b7cce51fb to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/f1/4345a153062e450dbef20a3b7cce51fb 2023-02-13 17:55:15,540 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/recovered.edits/15.seqid to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746/recovered.edits/15.seqid 2023-02-13 17:55:15,541 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testGetAfterCompaction/2b583a2a91797baaacc08ea86fce6746 2023-02-13 17:55:15,541 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-02-13 17:55:15,541 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-02-13 17:55:15,542 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1] 2023-02-13 17:55:15,544 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230213462a1c1332d24fd9b8626855023e3c85 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230213462a1c1332d24fd9b8626855023e3c85 2023-02-13 17:55:15,545 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-02-13 17:55:15,547 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=78, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-13 17:55:15,568 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testGetAfterCompaction from hbase:meta 2023-02-13 17:55:15,570 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testGetAfterCompaction' descriptor. 2023-02-13 17:55:15,571 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=78, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-13 17:55:15,571 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testGetAfterCompaction' from region states. 2023-02-13 17:55:15,571 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction,,1676310909973.2b583a2a91797baaacc08ea86fce6746.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676310915571"}]},"ts":"9223372036854775807"} 2023-02-13 17:55:15,572 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-13 17:55:15,572 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 2b583a2a91797baaacc08ea86fce6746, NAME => 'testGetAfterCompaction,,1676310909973.2b583a2a91797baaacc08ea86fce6746.', STARTKEY => '', ENDKEY => ''}] 2023-02-13 17:55:15,572 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testGetAfterCompaction' as deleted. 2023-02-13 17:55:15,573 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676310915572"}]},"ts":"9223372036854775807"} 2023-02-13 17:55:15,574 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testGetAfterCompaction state from META 2023-02-13 17:55:15,576 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=78, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-13 17:55:15,577 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; DeleteTableProcedure table=testGetAfterCompaction in 55 msec 2023-02-13 17:55:15,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=78 2023-02-13 17:55:15,630 INFO [Listener at localhost/35343] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testGetAfterCompaction, procId: 78 completed 2023-02-13 17:55:15,642 INFO [Listener at localhost/35343] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=245 (was 239) - Thread LEAK? -, OpenFileDescriptor=615 (was 609) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=146 (was 150), ProcessCount=168 (was 168), AvailableMemoryMB=973 (was 974) 2023-02-13 17:55:15,653 INFO [Listener at localhost/35343] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=245, OpenFileDescriptor=615, MaxFileDescriptor=60000, SystemLoadAverage=146, ProcessCount=168, AvailableMemoryMB=972 2023-02-13 17:55:15,655 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-13 17:55:15,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testCompactionWithHFileLink 2023-02-13 17:55:15,657 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 17:55:15,657 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testCompactionWithHFileLink" procId is: 79 2023-02-13 17:55:15,657 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 17:55:15,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-13 17:55:15,659 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911 2023-02-13 17:55:15,659 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81 2023-02-13 17:55:15,660 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113 2023-02-13 17:55:15,660 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911 empty. 2023-02-13 17:55:15,660 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113 empty. 2023-02-13 17:55:15,660 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81 empty. 2023-02-13 17:55:15,660 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911 2023-02-13 17:55:15,660 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113 2023-02-13 17:55:15,660 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81 2023-02-13 17:55:15,661 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testCompactionWithHFileLink regions 2023-02-13 17:55:15,669 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-02-13 17:55:15,670 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(7671): creating {ENCODED => 3100400af58d7bf345cc01ad0d304911, NAME => 'testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp 2023-02-13 17:55:15,671 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(7671): creating {ENCODED => bb026d2891c65ad4947af9cdbd2aee81, NAME => 'testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp 2023-02-13 17:55:15,676 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(7671): creating {ENCODED => feb7d9eaf104f779ab1be2f45a76a113, NAME => 'testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp 2023-02-13 17:55:15,688 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 17:55:15,688 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 17:55:15,689 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1603): Closing 3100400af58d7bf345cc01ad0d304911, disabling compactions & flushes 2023-02-13 17:55:15,689 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1603): Closing feb7d9eaf104f779ab1be2f45a76a113, disabling compactions & flushes 2023-02-13 17:55:15,689 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911. 2023-02-13 17:55:15,689 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911. 2023-02-13 17:55:15,689 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113. 2023-02-13 17:55:15,689 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911. after waiting 0 ms 2023-02-13 17:55:15,689 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911. 2023-02-13 17:55:15,689 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113. 2023-02-13 17:55:15,689 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911. 2023-02-13 17:55:15,689 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113. after waiting 0 ms 2023-02-13 17:55:15,689 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1557): Region close journal for 3100400af58d7bf345cc01ad0d304911: Waiting for close lock at 1676310915689Disabling compacts and flushes for region at 1676310915689Disabling writes for close at 1676310915689Writing region close event to WAL at 1676310915689Closed at 1676310915689 2023-02-13 17:55:15,689 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113. 2023-02-13 17:55:15,689 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113. 2023-02-13 17:55:15,689 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1557): Region close journal for feb7d9eaf104f779ab1be2f45a76a113: Waiting for close lock at 1676310915689Disabling compacts and flushes for region at 1676310915689Disabling writes for close at 1676310915689Writing region close event to WAL at 1676310915689Closed at 1676310915689 2023-02-13 17:55:15,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-13 17:55:15,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-13 17:55:16,086 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 17:55:16,086 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1603): Closing bb026d2891c65ad4947af9cdbd2aee81, disabling compactions & flushes 2023-02-13 17:55:16,086 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81. 2023-02-13 17:55:16,086 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81. 2023-02-13 17:55:16,086 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81. after waiting 0 ms 2023-02-13 17:55:16,086 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81. 2023-02-13 17:55:16,086 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81. 2023-02-13 17:55:16,086 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1557): Region close journal for bb026d2891c65ad4947af9cdbd2aee81: Waiting for close lock at 1676310916086Disabling compacts and flushes for region at 1676310916086Disabling writes for close at 1676310916086Writing region close event to WAL at 1676310916086Closed at 1676310916086 2023-02-13 17:55:16,088 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 17:55:16,089 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676310916089"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676310916089"}]},"ts":"1676310916089"} 2023-02-13 17:55:16,089 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676310916089"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676310916089"}]},"ts":"1676310916089"} 2023-02-13 17:55:16,089 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676310916089"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676310916089"}]},"ts":"1676310916089"} 2023-02-13 17:55:16,091 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-13 17:55:16,091 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 17:55:16,091 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676310916091"}]},"ts":"1676310916091"} 2023-02-13 17:55:16,092 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-02-13 17:55:16,098 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3100400af58d7bf345cc01ad0d304911, ASSIGN}, {pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=bb026d2891c65ad4947af9cdbd2aee81, ASSIGN}, {pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=feb7d9eaf104f779ab1be2f45a76a113, ASSIGN}] 2023-02-13 17:55:16,099 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3100400af58d7bf345cc01ad0d304911, ASSIGN 2023-02-13 17:55:16,099 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=feb7d9eaf104f779ab1be2f45a76a113, ASSIGN 2023-02-13 17:55:16,100 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=bb026d2891c65ad4947af9cdbd2aee81, ASSIGN 2023-02-13 17:55:16,100 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3100400af58d7bf345cc01ad0d304911, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38881,1676310818035; forceNewPlan=false, retain=false 2023-02-13 17:55:16,100 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=feb7d9eaf104f779ab1be2f45a76a113, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38881,1676310818035; forceNewPlan=false, retain=false 2023-02-13 17:55:16,100 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=bb026d2891c65ad4947af9cdbd2aee81, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38881,1676310818035; forceNewPlan=false, retain=false 2023-02-13 17:55:16,252 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=bb026d2891c65ad4947af9cdbd2aee81, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:16,252 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=feb7d9eaf104f779ab1be2f45a76a113, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:16,252 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=3100400af58d7bf345cc01ad0d304911, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:16,252 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676310916252"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676310916252"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676310916252"}]},"ts":"1676310916252"} 2023-02-13 17:55:16,252 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676310916252"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676310916252"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676310916252"}]},"ts":"1676310916252"} 2023-02-13 17:55:16,252 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676310916252"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676310916252"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676310916252"}]},"ts":"1676310916252"} 2023-02-13 17:55:16,254 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=83, ppid=81, state=RUNNABLE; OpenRegionProcedure bb026d2891c65ad4947af9cdbd2aee81, server=jenkins-hbase4.apache.org,38881,1676310818035}] 2023-02-13 17:55:16,254 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=84, ppid=80, state=RUNNABLE; OpenRegionProcedure 3100400af58d7bf345cc01ad0d304911, server=jenkins-hbase4.apache.org,38881,1676310818035}] 2023-02-13 17:55:16,256 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=82, state=RUNNABLE; OpenRegionProcedure feb7d9eaf104f779ab1be2f45a76a113, server=jenkins-hbase4.apache.org,38881,1676310818035}] 2023-02-13 17:55:16,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-13 17:55:16,409 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81. 2023-02-13 17:55:16,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => bb026d2891c65ad4947af9cdbd2aee81, NAME => 'testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81.', STARTKEY => '1', ENDKEY => '2'} 2023-02-13 17:55:16,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink bb026d2891c65ad4947af9cdbd2aee81 2023-02-13 17:55:16,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 17:55:16,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for bb026d2891c65ad4947af9cdbd2aee81 2023-02-13 17:55:16,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for bb026d2891c65ad4947af9cdbd2aee81 2023-02-13 17:55:16,411 INFO [StoreOpener-bb026d2891c65ad4947af9cdbd2aee81-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region bb026d2891c65ad4947af9cdbd2aee81 2023-02-13 17:55:16,412 DEBUG [StoreOpener-bb026d2891c65ad4947af9cdbd2aee81-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1 2023-02-13 17:55:16,412 DEBUG [StoreOpener-bb026d2891c65ad4947af9cdbd2aee81-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1 2023-02-13 17:55:16,412 INFO [StoreOpener-bb026d2891c65ad4947af9cdbd2aee81-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bb026d2891c65ad4947af9cdbd2aee81 columnFamilyName family1 2023-02-13 17:55:16,413 INFO [StoreOpener-bb026d2891c65ad4947af9cdbd2aee81-1] regionserver.HStore(310): Store=bb026d2891c65ad4947af9cdbd2aee81/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 17:55:16,414 INFO [StoreOpener-bb026d2891c65ad4947af9cdbd2aee81-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region bb026d2891c65ad4947af9cdbd2aee81 2023-02-13 17:55:16,415 DEBUG [StoreOpener-bb026d2891c65ad4947af9cdbd2aee81-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2 2023-02-13 17:55:16,415 DEBUG [StoreOpener-bb026d2891c65ad4947af9cdbd2aee81-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2 2023-02-13 17:55:16,415 INFO [StoreOpener-bb026d2891c65ad4947af9cdbd2aee81-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bb026d2891c65ad4947af9cdbd2aee81 columnFamilyName family2 2023-02-13 17:55:16,416 INFO [StoreOpener-bb026d2891c65ad4947af9cdbd2aee81-1] regionserver.HStore(310): Store=bb026d2891c65ad4947af9cdbd2aee81/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 17:55:16,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81 2023-02-13 17:55:16,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81 2023-02-13 17:55:16,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 17:55:16,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for bb026d2891c65ad4947af9cdbd2aee81 2023-02-13 17:55:16,421 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 17:55:16,422 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened bb026d2891c65ad4947af9cdbd2aee81; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63378477, jitterRate=-0.05558709800243378}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 17:55:16,422 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for bb026d2891c65ad4947af9cdbd2aee81: Running coprocessor pre-open hook at 1676310916410Writing region info on filesystem at 1676310916410Initializing all the Stores at 1676310916410Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676310916410Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676310916411 (+1 ms)Cleaning up temporary data from old regions at 1676310916418 (+7 ms)Cleaning up detritus from prior splits at 1676310916418Running coprocessor post-open hooks at 1676310916422 (+4 ms)Region opened successfully at 1676310916422 2023-02-13 17:55:16,422 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81., pid=83, masterSystemTime=1676310916406 2023-02-13 17:55:16,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81. 2023-02-13 17:55:16,424 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81. 2023-02-13 17:55:16,424 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911. 2023-02-13 17:55:16,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3100400af58d7bf345cc01ad0d304911, NAME => 'testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911.', STARTKEY => '', ENDKEY => '1'} 2023-02-13 17:55:16,424 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=bb026d2891c65ad4947af9cdbd2aee81, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:16,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 3100400af58d7bf345cc01ad0d304911 2023-02-13 17:55:16,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 17:55:16,424 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676310916424"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676310916424"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676310916424"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676310916424"}]},"ts":"1676310916424"} 2023-02-13 17:55:16,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3100400af58d7bf345cc01ad0d304911 2023-02-13 17:55:16,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3100400af58d7bf345cc01ad0d304911 2023-02-13 17:55:16,425 INFO [StoreOpener-3100400af58d7bf345cc01ad0d304911-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 3100400af58d7bf345cc01ad0d304911 2023-02-13 17:55:16,426 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=83, resume processing ppid=81 2023-02-13 17:55:16,427 DEBUG [StoreOpener-3100400af58d7bf345cc01ad0d304911-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1 2023-02-13 17:55:16,427 DEBUG [StoreOpener-3100400af58d7bf345cc01ad0d304911-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1 2023-02-13 17:55:16,427 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=83, ppid=81, state=SUCCESS; OpenRegionProcedure bb026d2891c65ad4947af9cdbd2aee81, server=jenkins-hbase4.apache.org,38881,1676310818035 in 171 msec 2023-02-13 17:55:16,427 INFO [StoreOpener-3100400af58d7bf345cc01ad0d304911-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3100400af58d7bf345cc01ad0d304911 columnFamilyName family1 2023-02-13 17:55:16,427 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=bb026d2891c65ad4947af9cdbd2aee81, ASSIGN in 331 msec 2023-02-13 17:55:16,428 INFO [StoreOpener-3100400af58d7bf345cc01ad0d304911-1] regionserver.HStore(310): Store=3100400af58d7bf345cc01ad0d304911/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 17:55:16,428 INFO [StoreOpener-3100400af58d7bf345cc01ad0d304911-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 3100400af58d7bf345cc01ad0d304911 2023-02-13 17:55:16,429 DEBUG [StoreOpener-3100400af58d7bf345cc01ad0d304911-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2 2023-02-13 17:55:16,429 DEBUG [StoreOpener-3100400af58d7bf345cc01ad0d304911-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2 2023-02-13 17:55:16,430 INFO [StoreOpener-3100400af58d7bf345cc01ad0d304911-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3100400af58d7bf345cc01ad0d304911 columnFamilyName family2 2023-02-13 17:55:16,430 INFO [StoreOpener-3100400af58d7bf345cc01ad0d304911-1] regionserver.HStore(310): Store=3100400af58d7bf345cc01ad0d304911/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 17:55:16,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911 2023-02-13 17:55:16,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911 2023-02-13 17:55:16,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 17:55:16,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3100400af58d7bf345cc01ad0d304911 2023-02-13 17:55:16,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 17:55:16,435 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3100400af58d7bf345cc01ad0d304911; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63679820, jitterRate=-0.05109673738479614}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 17:55:16,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3100400af58d7bf345cc01ad0d304911: Running coprocessor pre-open hook at 1676310916424Writing region info on filesystem at 1676310916424Initializing all the Stores at 1676310916425 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676310916425Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676310916425Cleaning up temporary data from old regions at 1676310916432 (+7 ms)Cleaning up detritus from prior splits at 1676310916432Running coprocessor post-open hooks at 1676310916435 (+3 ms)Region opened successfully at 1676310916435 2023-02-13 17:55:16,436 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911., pid=84, masterSystemTime=1676310916406 2023-02-13 17:55:16,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911. 2023-02-13 17:55:16,437 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911. 2023-02-13 17:55:16,437 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113. 2023-02-13 17:55:16,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => feb7d9eaf104f779ab1be2f45a76a113, NAME => 'testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113.', STARTKEY => '2', ENDKEY => ''} 2023-02-13 17:55:16,437 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=3100400af58d7bf345cc01ad0d304911, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:16,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink feb7d9eaf104f779ab1be2f45a76a113 2023-02-13 17:55:16,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 17:55:16,437 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676310916437"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676310916437"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676310916437"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676310916437"}]},"ts":"1676310916437"} 2023-02-13 17:55:16,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for feb7d9eaf104f779ab1be2f45a76a113 2023-02-13 17:55:16,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for feb7d9eaf104f779ab1be2f45a76a113 2023-02-13 17:55:16,438 INFO [StoreOpener-feb7d9eaf104f779ab1be2f45a76a113-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region feb7d9eaf104f779ab1be2f45a76a113 2023-02-13 17:55:16,440 DEBUG [StoreOpener-feb7d9eaf104f779ab1be2f45a76a113-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1 2023-02-13 17:55:16,440 DEBUG [StoreOpener-feb7d9eaf104f779ab1be2f45a76a113-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1 2023-02-13 17:55:16,440 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=84, resume processing ppid=80 2023-02-13 17:55:16,440 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=84, ppid=80, state=SUCCESS; OpenRegionProcedure 3100400af58d7bf345cc01ad0d304911, server=jenkins-hbase4.apache.org,38881,1676310818035 in 184 msec 2023-02-13 17:55:16,440 INFO [StoreOpener-feb7d9eaf104f779ab1be2f45a76a113-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region feb7d9eaf104f779ab1be2f45a76a113 columnFamilyName family1 2023-02-13 17:55:16,441 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=80, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3100400af58d7bf345cc01ad0d304911, ASSIGN in 344 msec 2023-02-13 17:55:16,441 INFO [StoreOpener-feb7d9eaf104f779ab1be2f45a76a113-1] regionserver.HStore(310): Store=feb7d9eaf104f779ab1be2f45a76a113/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 17:55:16,441 INFO [StoreOpener-feb7d9eaf104f779ab1be2f45a76a113-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region feb7d9eaf104f779ab1be2f45a76a113 2023-02-13 17:55:16,442 DEBUG [StoreOpener-feb7d9eaf104f779ab1be2f45a76a113-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2 2023-02-13 17:55:16,442 DEBUG [StoreOpener-feb7d9eaf104f779ab1be2f45a76a113-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2 2023-02-13 17:55:16,442 INFO [StoreOpener-feb7d9eaf104f779ab1be2f45a76a113-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region feb7d9eaf104f779ab1be2f45a76a113 columnFamilyName family2 2023-02-13 17:55:16,443 INFO [StoreOpener-feb7d9eaf104f779ab1be2f45a76a113-1] regionserver.HStore(310): Store=feb7d9eaf104f779ab1be2f45a76a113/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 17:55:16,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113 2023-02-13 17:55:16,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113 2023-02-13 17:55:16,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 17:55:16,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for feb7d9eaf104f779ab1be2f45a76a113 2023-02-13 17:55:16,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 17:55:16,448 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened feb7d9eaf104f779ab1be2f45a76a113; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64877473, jitterRate=-0.033250316977500916}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 17:55:16,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for feb7d9eaf104f779ab1be2f45a76a113: Running coprocessor pre-open hook at 1676310916437Writing region info on filesystem at 1676310916437Initializing all the Stores at 1676310916438 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676310916438Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676310916438Cleaning up temporary data from old regions at 1676310916444 (+6 ms)Cleaning up detritus from prior splits at 1676310916445 (+1 ms)Running coprocessor post-open hooks at 1676310916448 (+3 ms)Region opened successfully at 1676310916448 2023-02-13 17:55:16,448 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113., pid=85, masterSystemTime=1676310916406 2023-02-13 17:55:16,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113. 2023-02-13 17:55:16,449 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113. 2023-02-13 17:55:16,450 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=feb7d9eaf104f779ab1be2f45a76a113, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:16,450 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676310916449"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676310916449"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676310916449"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676310916449"}]},"ts":"1676310916449"} 2023-02-13 17:55:16,451 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=82 2023-02-13 17:55:16,452 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=82, state=SUCCESS; OpenRegionProcedure feb7d9eaf104f779ab1be2f45a76a113, server=jenkins-hbase4.apache.org,38881,1676310818035 in 196 msec 2023-02-13 17:55:16,453 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=79 2023-02-13 17:55:16,453 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=feb7d9eaf104f779ab1be2f45a76a113, ASSIGN in 354 msec 2023-02-13 17:55:16,453 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 17:55:16,453 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676310916453"}]},"ts":"1676310916453"} 2023-02-13 17:55:16,454 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-02-13 17:55:16,456 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 17:55:16,457 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; CreateTableProcedure table=testCompactionWithHFileLink in 801 msec 2023-02-13 17:55:16,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-13 17:55:16,761 INFO [Listener at localhost/35343] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testCompactionWithHFileLink, procId: 79 completed 2023-02-13 17:55:16,767 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 17:55:16,769 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 17:55:16,769 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 17:55:16,772 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:55:16,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-13 17:55:16,773 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-13 17:55:16,773 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:55:16,773 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-13 17:55:16,773 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-13 17:55:16,774 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 17:55:16,774 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 17:55:16,775 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:16,775 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:55:16,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:55:16,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:55:16,775 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:16,775 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:55:16,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 17:55:16,776 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 17:55:16,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:55:16,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 17:55:16,776 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-13 17:55:16,776 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-13 17:55:16,776 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-13 17:55:16,776 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:55:16,776 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-13 17:55:16,776 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113. 2023-02-13 17:55:16,777 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113. started... 2023-02-13 17:55:16,777 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 17:55:16,777 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:55:16,777 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911. 2023-02-13 17:55:16,777 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81. 2023-02-13 17:55:16,777 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing feb7d9eaf104f779ab1be2f45a76a113 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-13 17:55:16,777 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81. started... 2023-02-13 17:55:16,777 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911. started... 2023-02-13 17:55:16,778 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing bb026d2891c65ad4947af9cdbd2aee81 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-13 17:55:16,778 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 3100400af58d7bf345cc01ad0d304911 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-13 17:55:16,791 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213c31399a9990c4a3c804dfe04b8369883 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213c31399a9990c4a3c804dfe04b8369883 2023-02-13 17:55:17,191 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213a4cfd932ee82497b8b48fce3a3315d3a to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230213a4cfd932ee82497b8b48fce3a3315d3a 2023-02-13 17:55:17,191 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213fc2538b358534706a24fbf98242dfa71 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213fc2538b358534706a24fbf98242dfa71 2023-02-13 17:55:17,196 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/.tmp/family1/e6560096ecd74736bebc5405b1d1b2a3 2023-02-13 17:55:17,596 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/.tmp/family1/3e7fe91c378b40949900da15f97302b5 2023-02-13 17:55:17,596 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/.tmp/family1/42c1aafe213742ee932d1cd3d96850c5 2023-02-13 17:55:17,607 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302130e6f46dd9ee54f61b0b7f5bacda45b0f to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302130e6f46dd9ee54f61b0b7f5bacda45b0f 2023-02-13 17:55:18,011 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/.tmp/family2/32c4ec93ee254178b71387a374784c01 2023-02-13 17:55:18,013 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213e61b7b133da1408695c38873c776d0f7 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213e61b7b133da1408695c38873c776d0f7 2023-02-13 17:55:18,014 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213fa36eef8827840ccb1f6f6e87f5dbeb0 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213fa36eef8827840ccb1f6f6e87f5dbeb0 2023-02-13 17:55:18,015 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/.tmp/family1/e6560096ecd74736bebc5405b1d1b2a3 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/e6560096ecd74736bebc5405b1d1b2a3 2023-02-13 17:55:18,020 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/e6560096ecd74736bebc5405b1d1b2a3, entries=4, sequenceid=5, filesize=5.4 K 2023-02-13 17:55:18,020 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/.tmp/family2/32c4ec93ee254178b71387a374784c01 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2/32c4ec93ee254178b71387a374784c01 2023-02-13 17:55:18,024 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2/32c4ec93ee254178b71387a374784c01, entries=2, sequenceid=5, filesize=5.1 K 2023-02-13 17:55:18,024 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 3100400af58d7bf345cc01ad0d304911 in 1246ms, sequenceid=5, compaction requested=false 2023-02-13 17:55:18,025 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-02-13 17:55:18,025 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 3100400af58d7bf345cc01ad0d304911: 2023-02-13 17:55:18,025 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911. 2023-02-13 17:55:18,025 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 17:55:18,028 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/.tmp/family2/4f54bee9443d4462a705bbaee479b92e 2023-02-13 17:55:18,031 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/.tmp/family1/42c1aafe213742ee932d1cd3d96850c5 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/42c1aafe213742ee932d1cd3d96850c5 2023-02-13 17:55:18,034 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/42c1aafe213742ee932d1cd3d96850c5, entries=4, sequenceid=5, filesize=5.4 K 2023-02-13 17:55:18,035 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/.tmp/family2/4f54bee9443d4462a705bbaee479b92e as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2/4f54bee9443d4462a705bbaee479b92e 2023-02-13 17:55:18,038 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2/4f54bee9443d4462a705bbaee479b92e, entries=2, sequenceid=5, filesize=5.1 K 2023-02-13 17:55:18,039 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for feb7d9eaf104f779ab1be2f45a76a113 in 1262ms, sequenceid=5, compaction requested=false 2023-02-13 17:55:18,039 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for feb7d9eaf104f779ab1be2f45a76a113: 2023-02-13 17:55:18,039 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113. 2023-02-13 17:55:18,040 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 17:55:18,419 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/.tmp/family2/608fde33f61b4c5985d5cd904d692f90 2023-02-13 17:55:18,424 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/.tmp/family1/3e7fe91c378b40949900da15f97302b5 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/3e7fe91c378b40949900da15f97302b5 2023-02-13 17:55:18,427 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/3e7fe91c378b40949900da15f97302b5, entries=4, sequenceid=5, filesize=5.4 K 2023-02-13 17:55:18,428 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/.tmp/family2/608fde33f61b4c5985d5cd904d692f90 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2/608fde33f61b4c5985d5cd904d692f90 2023-02-13 17:55:18,432 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2/608fde33f61b4c5985d5cd904d692f90, entries=2, sequenceid=5, filesize=5.1 K 2023-02-13 17:55:18,433 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for bb026d2891c65ad4947af9cdbd2aee81 in 1655ms, sequenceid=5, compaction requested=false 2023-02-13 17:55:18,433 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for bb026d2891c65ad4947af9cdbd2aee81: 2023-02-13 17:55:18,433 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81. 2023-02-13 17:55:18,433 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 17:55:18,433 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 17:55:18,433 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:18,433 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-13 17:55:18,433 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-13 17:55:18,435 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:18,435 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 17:55:18,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:18,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:55:18,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:55:18,436 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 17:55:18,436 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:55:18,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:55:18,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:55:18,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 17:55:18,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:18,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:55:18,437 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-13 17:55:18,437 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7f79d057[Count = 0] remaining members to acquire global barrier 2023-02-13 17:55:18,437 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-13 17:55:18,437 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 17:55:18,438 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 17:55:18,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 17:55:18,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 17:55:18,438 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-13 17:55:18,438 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-13 17:55:18,438 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:55:18,438 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:18,438 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:55:18,439 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-13 17:55:18,439 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:18,439 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:55:18,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:18,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:55:18,440 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-13 17:55:18,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:55:18,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:55:18,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:55:18,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 17:55:18,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:18,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:55:18,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 17:55:18,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:18,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:55:18,442 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-13 17:55:18,442 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-13 17:55:18,442 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:55:18,442 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:55:18,442 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-13 17:55:18,442 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:55:18,443 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 17:55:18,443 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 17:55:18,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 17:55:18,443 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:55:18,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:55:18,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:55:18,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 17:55:18,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 17:55:18,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:55:18,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:55:18,444 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:18,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:55:18,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 17:55:18,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 17:55:18,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:55:18,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 17:55:18,445 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:18,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:18,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:55:18,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 17:55:18,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:18,448 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:18,448 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:55:18,448 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 17:55:18,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:55:18,448 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-13 17:55:18,448 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:55:18,448 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:55:18,448 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:55:18,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:55:18,448 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-02-13 17:55:18,448 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 17:55:18,448 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-13 17:55:18,448 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:55:18,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:55:18,448 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:18,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:55:18,448 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 17:55:18,448 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 17:55:18,448 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 17:55:18,548 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:55:18,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:55:18,550 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 17:55:18,550 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 17:55:18,551 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 17:55:18,553 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:55:18,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-02-13 17:55:18,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-13 17:55:18,555 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-13 17:55:18,555 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:55:18,555 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-13 17:55:18,555 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-13 17:55:18,555 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 17:55:18,555 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 17:55:18,557 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:18,557 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:55:18,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:55:18,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:55:18,557 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:18,557 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:55:18,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 17:55:18,557 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 17:55:18,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:55:18,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 17:55:18,558 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-13 17:55:18,558 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-02-13 17:55:18,558 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-13 17:55:18,558 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-13 17:55:18,558 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:55:18,558 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-13 17:55:18,559 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113. 2023-02-13 17:55:18,559 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113. started... 2023-02-13 17:55:18,559 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 17:55:18,559 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81. 2023-02-13 17:55:18,559 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing feb7d9eaf104f779ab1be2f45a76a113 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-13 17:55:18,559 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81. started... 2023-02-13 17:55:18,559 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911. 2023-02-13 17:55:18,559 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911. started... 2023-02-13 17:55:18,559 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:55:18,559 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing bb026d2891c65ad4947af9cdbd2aee81 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-13 17:55:18,559 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 3100400af58d7bf345cc01ad0d304911 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-13 17:55:18,982 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213a359d3362aaa4dcd968c7b94fd314224 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213a359d3362aaa4dcd968c7b94fd314224 2023-02-13 17:55:18,982 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302137a1f3d451d5c4326baf651a772ecb753 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302137a1f3d451d5c4326baf651a772ecb753 2023-02-13 17:55:18,982 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302139d7d463af0d4438b8241da37c0ba0354 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302139d7d463af0d4438b8241da37c0ba0354 2023-02-13 17:55:19,388 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/.tmp/family1/3a283a50ba284dc4a28a1af04674d6c4 2023-02-13 17:55:19,388 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/.tmp/family1/2dbd654356cf49ada19b27aa5ddccb8a 2023-02-13 17:55:19,388 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/.tmp/family1/437f6f10fd1b4a209c4b0d4fa2e21fc8 2023-02-13 17:55:19,806 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021351acaee0ed8b40278ec2b3f56036883b to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023021351acaee0ed8b40278ec2b3f56036883b 2023-02-13 17:55:19,808 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021320dc1eb6d4724a889be45ca3e3146c4f to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023021320dc1eb6d4724a889be45ca3e3146c4f 2023-02-13 17:55:19,808 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021374f9927dd8c94d258aa4b2f117e9d6d1 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021374f9927dd8c94d258aa4b2f117e9d6d1 2023-02-13 17:55:20,214 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/.tmp/family2/8be2efbf57b743b085c80dd2eb0afaa9 2023-02-13 17:55:20,214 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/.tmp/family2/23f1089685c348a29b8ec869d0066855 2023-02-13 17:55:20,216 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/.tmp/family2/e87955f045b64484847b386ef6899d94 2023-02-13 17:55:20,218 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/.tmp/family1/3a283a50ba284dc4a28a1af04674d6c4 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/3a283a50ba284dc4a28a1af04674d6c4 2023-02-13 17:55:20,218 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/.tmp/family1/2dbd654356cf49ada19b27aa5ddccb8a as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/2dbd654356cf49ada19b27aa5ddccb8a 2023-02-13 17:55:20,220 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/.tmp/family1/437f6f10fd1b4a209c4b0d4fa2e21fc8 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/437f6f10fd1b4a209c4b0d4fa2e21fc8 2023-02-13 17:55:20,222 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/3a283a50ba284dc4a28a1af04674d6c4, entries=4, sequenceid=9, filesize=5.4 K 2023-02-13 17:55:20,222 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/2dbd654356cf49ada19b27aa5ddccb8a, entries=4, sequenceid=9, filesize=5.4 K 2023-02-13 17:55:20,223 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/.tmp/family2/23f1089685c348a29b8ec869d0066855 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2/23f1089685c348a29b8ec869d0066855 2023-02-13 17:55:20,223 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/.tmp/family2/8be2efbf57b743b085c80dd2eb0afaa9 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2/8be2efbf57b743b085c80dd2eb0afaa9 2023-02-13 17:55:20,224 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/437f6f10fd1b4a209c4b0d4fa2e21fc8, entries=4, sequenceid=9, filesize=5.4 K 2023-02-13 17:55:20,225 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/.tmp/family2/e87955f045b64484847b386ef6899d94 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2/e87955f045b64484847b386ef6899d94 2023-02-13 17:55:20,227 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2/23f1089685c348a29b8ec869d0066855, entries=2, sequenceid=9, filesize=5.1 K 2023-02-13 17:55:20,228 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2/8be2efbf57b743b085c80dd2eb0afaa9, entries=2, sequenceid=9, filesize=5.1 K 2023-02-13 17:55:20,228 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for bb026d2891c65ad4947af9cdbd2aee81 in 1669ms, sequenceid=9, compaction requested=false 2023-02-13 17:55:20,228 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 3100400af58d7bf345cc01ad0d304911 in 1669ms, sequenceid=9, compaction requested=false 2023-02-13 17:55:20,228 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for bb026d2891c65ad4947af9cdbd2aee81: 2023-02-13 17:55:20,228 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 3100400af58d7bf345cc01ad0d304911: 2023-02-13 17:55:20,228 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81. 2023-02-13 17:55:20,228 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911. 2023-02-13 17:55:20,228 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 17:55:20,229 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 17:55:20,229 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2/e87955f045b64484847b386ef6899d94, entries=2, sequenceid=9, filesize=5.1 K 2023-02-13 17:55:20,229 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for feb7d9eaf104f779ab1be2f45a76a113 in 1670ms, sequenceid=9, compaction requested=false 2023-02-13 17:55:20,229 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for feb7d9eaf104f779ab1be2f45a76a113: 2023-02-13 17:55:20,230 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113. 2023-02-13 17:55:20,230 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 17:55:20,230 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 17:55:20,230 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:20,230 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-13 17:55:20,230 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-13 17:55:20,232 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 17:55:20,232 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:20,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:20,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:55:20,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:55:20,232 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 17:55:20,232 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:55:20,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:55:20,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:55:20,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 17:55:20,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:20,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:55:20,233 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-13 17:55:20,233 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@c330e7c[Count = 0] remaining members to acquire global barrier 2023-02-13 17:55:20,233 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-13 17:55:20,233 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 17:55:20,234 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 17:55:20,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 17:55:20,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 17:55:20,234 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-13 17:55:20,234 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-13 17:55:20,234 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:55:20,234 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:20,234 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:55:20,237 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-13 17:55:20,237 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:20,237 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:55:20,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:20,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:55:20,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:55:20,237 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-13 17:55:20,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:55:20,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:55:20,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 17:55:20,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:20,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:55:20,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 17:55:20,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:20,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:55:20,239 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-13 17:55:20,239 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-13 17:55:20,239 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:55:20,239 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:55:20,239 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-13 17:55:20,239 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:55:20,240 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 17:55:20,240 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 17:55:20,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 17:55:20,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 17:55:20,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:55:20,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:55:20,240 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:55:20,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 17:55:20,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:55:20,240 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:20,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:55:20,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:55:20,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 17:55:20,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 17:55:20,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:55:20,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 17:55:20,241 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:20,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:20,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:55:20,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 17:55:20,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:20,243 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:20,243 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:55:20,244 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 17:55:20,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:55:20,244 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-13 17:55:20,244 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:55:20,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:55:20,244 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:55:20,244 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 17:55:20,244 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:20,244 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 17:55:20,244 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:55:20,244 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 17:55:20,244 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-13 17:55:20,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:55:20,244 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 17:55:20,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:55:20,244 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:55:20,344 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:55:20,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:55:20,346 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 17:55:20,347 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 17:55:20,347 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 17:55:20,349 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:55:20,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-02-13 17:55:20,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-13 17:55:20,351 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-13 17:55:20,351 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:55:20,352 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-13 17:55:20,352 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-13 17:55:20,352 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 17:55:20,352 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 17:55:20,353 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:20,353 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:55:20,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:55:20,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:55:20,354 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:20,354 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:55:20,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 17:55:20,354 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 17:55:20,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:55:20,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 17:55:20,354 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-13 17:55:20,355 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-02-13 17:55:20,355 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-13 17:55:20,355 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-13 17:55:20,355 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:55:20,355 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-13 17:55:20,355 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113. 2023-02-13 17:55:20,355 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 17:55:20,355 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81. 2023-02-13 17:55:20,355 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911. 2023-02-13 17:55:20,355 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911. started... 2023-02-13 17:55:20,355 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81. started... 2023-02-13 17:55:20,355 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:55:20,355 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113. started... 2023-02-13 17:55:20,355 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 3100400af58d7bf345cc01ad0d304911 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-13 17:55:20,355 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing bb026d2891c65ad4947af9cdbd2aee81 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-13 17:55:20,355 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing feb7d9eaf104f779ab1be2f45a76a113 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-13 17:55:20,772 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021396722928928e4a41a06aa70fc6c582a1 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023021396722928928e4a41a06aa70fc6c582a1 2023-02-13 17:55:20,772 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302137eee19f62fc045d89ef731f1c9530586 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302137eee19f62fc045d89ef731f1c9530586 2023-02-13 17:55:20,773 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302137ce51ed0124b4c47be89d64a62b4981b to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302137ce51ed0124b4c47be89d64a62b4981b 2023-02-13 17:55:20,876 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 17:55:21,180 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/.tmp/family1/29b0fc5b96f14c4bacceeb69a12ebe2c 2023-02-13 17:55:21,180 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/.tmp/family1/097db5b1f29543ab9eb72d6e252351f3 2023-02-13 17:55:21,180 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/.tmp/family1/40923e1578564f6f8c56f4a4170ec489 2023-02-13 17:55:21,597 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021382fd91fd47aa4c0fbaf7ed083a913a76 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023021382fd91fd47aa4c0fbaf7ed083a913a76 2023-02-13 17:55:21,597 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213705bed6eac8c49e1a5117e8b5b3398e2 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213705bed6eac8c49e1a5117e8b5b3398e2 2023-02-13 17:55:21,597 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213082c4da7bd0d4f7f9c8784d8b945ad1b to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213082c4da7bd0d4f7f9c8784d8b945ad1b 2023-02-13 17:55:21,604 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/.tmp/family2/e52fd15b18ae474e807cbc2aedac7040 2023-02-13 17:55:21,607 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/.tmp/family1/097db5b1f29543ab9eb72d6e252351f3 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/097db5b1f29543ab9eb72d6e252351f3 2023-02-13 17:55:21,610 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/097db5b1f29543ab9eb72d6e252351f3, entries=4, sequenceid=13, filesize=5.4 K 2023-02-13 17:55:21,611 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/.tmp/family2/e52fd15b18ae474e807cbc2aedac7040 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2/e52fd15b18ae474e807cbc2aedac7040 2023-02-13 17:55:21,614 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2/e52fd15b18ae474e807cbc2aedac7040, entries=2, sequenceid=13, filesize=5.1 K 2023-02-13 17:55:21,615 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for feb7d9eaf104f779ab1be2f45a76a113 in 1260ms, sequenceid=13, compaction requested=true 2023-02-13 17:55:21,615 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for feb7d9eaf104f779ab1be2f45a76a113: 2023-02-13 17:55:21,615 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113. 2023-02-13 17:55:21,615 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 17:55:22,002 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/.tmp/family2/46a65080c58e40959b6f072bbd556cb4 2023-02-13 17:55:22,004 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/.tmp/family2/01097aa7d9cf4f0dbb75cfb2586a0995 2023-02-13 17:55:22,006 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/.tmp/family1/29b0fc5b96f14c4bacceeb69a12ebe2c as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/29b0fc5b96f14c4bacceeb69a12ebe2c 2023-02-13 17:55:22,008 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/.tmp/family1/40923e1578564f6f8c56f4a4170ec489 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/40923e1578564f6f8c56f4a4170ec489 2023-02-13 17:55:22,009 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/29b0fc5b96f14c4bacceeb69a12ebe2c, entries=4, sequenceid=13, filesize=5.4 K 2023-02-13 17:55:22,010 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/.tmp/family2/46a65080c58e40959b6f072bbd556cb4 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2/46a65080c58e40959b6f072bbd556cb4 2023-02-13 17:55:22,012 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/40923e1578564f6f8c56f4a4170ec489, entries=4, sequenceid=13, filesize=5.4 K 2023-02-13 17:55:22,013 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/.tmp/family2/01097aa7d9cf4f0dbb75cfb2586a0995 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2/01097aa7d9cf4f0dbb75cfb2586a0995 2023-02-13 17:55:22,014 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2/46a65080c58e40959b6f072bbd556cb4, entries=2, sequenceid=13, filesize=5.1 K 2023-02-13 17:55:22,015 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 3100400af58d7bf345cc01ad0d304911 in 1660ms, sequenceid=13, compaction requested=true 2023-02-13 17:55:22,015 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 3100400af58d7bf345cc01ad0d304911: 2023-02-13 17:55:22,015 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911. 2023-02-13 17:55:22,015 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 17:55:22,016 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2/01097aa7d9cf4f0dbb75cfb2586a0995, entries=2, sequenceid=13, filesize=5.1 K 2023-02-13 17:55:22,017 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for bb026d2891c65ad4947af9cdbd2aee81 in 1662ms, sequenceid=13, compaction requested=true 2023-02-13 17:55:22,017 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for bb026d2891c65ad4947af9cdbd2aee81: 2023-02-13 17:55:22,017 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81. 2023-02-13 17:55:22,017 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 17:55:22,017 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 17:55:22,017 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:22,017 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-13 17:55:22,017 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-13 17:55:22,022 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:22,022 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 17:55:22,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:22,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:55:22,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:55:22,022 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 17:55:22,022 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:55:22,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:55:22,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:55:22,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 17:55:22,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:22,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:55:22,023 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-13 17:55:22,023 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6591dee5[Count = 0] remaining members to acquire global barrier 2023-02-13 17:55:22,023 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-13 17:55:22,023 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 17:55:22,024 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 17:55:22,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 17:55:22,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 17:55:22,024 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-13 17:55:22,024 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-13 17:55:22,024 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:22,024 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:55:22,024 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:55:22,026 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-13 17:55:22,026 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:55:22,026 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:22,026 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-13 17:55:22,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:22,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:55:22,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:55:22,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:55:22,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:55:22,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 17:55:22,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:22,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:55:22,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 17:55:22,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:22,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:55:22,028 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-13 17:55:22,028 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-13 17:55:22,028 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:55:22,028 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:55:22,028 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-13 17:55:22,028 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:55:22,036 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 17:55:22,036 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 17:55:22,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 17:55:22,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 17:55:22,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:55:22,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 17:55:22,036 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:55:22,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:55:22,036 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:22,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:55:22,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:55:22,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:55:22,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 17:55:22,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 17:55:22,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:55:22,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 17:55:22,037 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:22,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:22,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:55:22,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 17:55:22,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:22,039 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:22,040 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 17:55:22,040 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 17:55:22,040 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:22,040 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:55:22,040 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:55:22,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:55:22,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:55:22,040 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:55:22,040 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-02-13 17:55:22,040 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-13 17:55:22,040 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:55:22,040 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 17:55:22,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:55:22,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:55:22,040 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 17:55:22,040 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 17:55:22,040 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-13 17:55:22,040 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:55:22,140 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:55:22,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:55:22,142 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 17:55:22,143 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 17:55:22,143 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 17:55:22,145 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:55:22,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-02-13 17:55:22,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-13 17:55:22,147 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-13 17:55:22,147 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:55:22,147 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-13 17:55:22,147 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-13 17:55:22,148 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 17:55:22,148 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 17:55:22,149 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:22,149 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:55:22,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:55:22,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:55:22,149 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:22,149 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:55:22,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 17:55:22,150 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 17:55:22,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:55:22,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 17:55:22,150 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-13 17:55:22,150 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-02-13 17:55:22,150 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-13 17:55:22,150 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-13 17:55:22,150 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:55:22,150 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-13 17:55:22,151 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113. 2023-02-13 17:55:22,151 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113. started... 2023-02-13 17:55:22,151 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing feb7d9eaf104f779ab1be2f45a76a113 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-13 17:55:22,152 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 17:55:22,152 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:55:22,152 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911. 2023-02-13 17:55:22,152 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81. 2023-02-13 17:55:22,152 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911. started... 2023-02-13 17:55:22,152 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81. started... 2023-02-13 17:55:22,152 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 3100400af58d7bf345cc01ad0d304911 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-13 17:55:22,152 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing bb026d2891c65ad4947af9cdbd2aee81 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-13 17:55:22,169 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213ee3933dd70424d2e834718749ce3b857 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230213ee3933dd70424d2e834718749ce3b857 2023-02-13 17:55:22,169 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213dbd37ffc9d744d64b5e96b9ce742d460 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213dbd37ffc9d744d64b5e96b9ce742d460 2023-02-13 17:55:22,176 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/.tmp/family1/75b940759fff45ea81b5b6e255f92641 2023-02-13 17:55:22,570 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213229fa23ca4364d5cbdb41b54922fba45 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213229fa23ca4364d5cbdb41b54922fba45 2023-02-13 17:55:22,575 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/.tmp/family1/e6249c54085e4a9b85698d7cdd4cd6f0 2023-02-13 17:55:22,588 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021379b796fff0374d62ad0e395fdddd106b to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023021379b796fff0374d62ad0e395fdddd106b 2023-02-13 17:55:22,974 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/.tmp/family1/cf51030f8e2f4a669ebdb6d63c1b2f69 2023-02-13 17:55:22,986 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213c3d4c88cedc34985b4a632a97934ed48 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213c3d4c88cedc34985b4a632a97934ed48 2023-02-13 17:55:22,992 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/.tmp/family2/833e250a6055443d880f3a93997896df 2023-02-13 17:55:22,995 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/.tmp/family1/75b940759fff45ea81b5b6e255f92641 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/75b940759fff45ea81b5b6e255f92641 2023-02-13 17:55:22,998 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/75b940759fff45ea81b5b6e255f92641, entries=4, sequenceid=17, filesize=5.4 K 2023-02-13 17:55:22,998 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/.tmp/family2/833e250a6055443d880f3a93997896df as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2/833e250a6055443d880f3a93997896df 2023-02-13 17:55:23,002 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2/833e250a6055443d880f3a93997896df, entries=2, sequenceid=17, filesize=5.1 K 2023-02-13 17:55:23,002 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for bb026d2891c65ad4947af9cdbd2aee81 in 850ms, sequenceid=17, compaction requested=true 2023-02-13 17:55:23,002 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for bb026d2891c65ad4947af9cdbd2aee81: 2023-02-13 17:55:23,002 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81. 2023-02-13 17:55:23,002 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 17:55:23,388 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213503e4be7eff3436cb2a36ee7d435aee7 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230213503e4be7eff3436cb2a36ee7d435aee7 2023-02-13 17:55:23,391 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/.tmp/family2/880a5ba4a8a74bb4b87ae5fa41be4939 2023-02-13 17:55:23,395 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/.tmp/family1/e6249c54085e4a9b85698d7cdd4cd6f0 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/e6249c54085e4a9b85698d7cdd4cd6f0 2023-02-13 17:55:23,398 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/e6249c54085e4a9b85698d7cdd4cd6f0, entries=4, sequenceid=17, filesize=5.4 K 2023-02-13 17:55:23,399 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/.tmp/family2/880a5ba4a8a74bb4b87ae5fa41be4939 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2/880a5ba4a8a74bb4b87ae5fa41be4939 2023-02-13 17:55:23,402 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2/880a5ba4a8a74bb4b87ae5fa41be4939, entries=2, sequenceid=17, filesize=5.1 K 2023-02-13 17:55:23,403 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for feb7d9eaf104f779ab1be2f45a76a113 in 1252ms, sequenceid=17, compaction requested=true 2023-02-13 17:55:23,403 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for feb7d9eaf104f779ab1be2f45a76a113: 2023-02-13 17:55:23,403 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113. 2023-02-13 17:55:23,403 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 17:55:23,793 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/.tmp/family2/e06eec59679249679bbc717b4a660668 2023-02-13 17:55:23,797 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/.tmp/family1/cf51030f8e2f4a669ebdb6d63c1b2f69 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/cf51030f8e2f4a669ebdb6d63c1b2f69 2023-02-13 17:55:23,801 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/cf51030f8e2f4a669ebdb6d63c1b2f69, entries=4, sequenceid=17, filesize=5.4 K 2023-02-13 17:55:23,801 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/.tmp/family2/e06eec59679249679bbc717b4a660668 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2/e06eec59679249679bbc717b4a660668 2023-02-13 17:55:23,805 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2/e06eec59679249679bbc717b4a660668, entries=2, sequenceid=17, filesize=5.1 K 2023-02-13 17:55:23,806 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 3100400af58d7bf345cc01ad0d304911 in 1654ms, sequenceid=17, compaction requested=true 2023-02-13 17:55:23,806 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 3100400af58d7bf345cc01ad0d304911: 2023-02-13 17:55:23,806 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911. 2023-02-13 17:55:23,806 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 17:55:23,806 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 17:55:23,806 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:23,806 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-13 17:55:23,806 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-13 17:55:23,809 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 17:55:23,809 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:23,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:23,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:55:23,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:55:23,809 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 17:55:23,809 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:55:23,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:55:23,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:55:23,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 17:55:23,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:23,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:55:23,810 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-13 17:55:23,811 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6929e30b[Count = 0] remaining members to acquire global barrier 2023-02-13 17:55:23,811 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-13 17:55:23,811 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 17:55:23,812 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 17:55:23,812 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 17:55:23,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 17:55:23,812 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-13 17:55:23,812 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:23,812 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:55:23,812 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-13 17:55:23,812 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:55:23,813 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:23,813 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-13 17:55:23,813 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:55:23,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:23,813 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-13 17:55:23,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:55:23,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:55:23,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:55:23,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:55:23,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 17:55:23,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:23,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:55:23,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 17:55:23,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:23,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:55:23,815 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-13 17:55:23,815 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:55:23,815 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:55:23,815 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-13 17:55:23,815 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:55:23,815 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-13 17:55:23,817 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 17:55:23,817 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 17:55:23,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 17:55:23,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 17:55:23,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 17:55:23,817 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:55:23,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:55:23,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:55:23,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:55:23,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:55:23,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:55:23,817 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:23,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 17:55:23,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 17:55:23,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:55:23,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 17:55:23,819 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:23,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:23,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:55:23,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 17:55:23,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:23,822 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:23,822 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 17:55:23,822 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 17:55:23,822 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:23,822 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 17:55:23,822 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:55:23,822 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:55:23,822 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-13 17:55:23,823 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:55:23,822 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 17:55:23,822 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:55:23,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:55:23,823 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-02-13 17:55:23,823 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-13 17:55:23,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:55:23,823 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 17:55:23,823 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:55:23,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:55:23,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:55:23,923 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:55:23,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:55:23,934 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb-1676310923924 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-13 17:55:23,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676310923934 (current time:1676310923934). 2023-02-13 17:55:23,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-13 17:55:23,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] zookeeper.ReadOnlyZKClient(139): Connect 0x5685d47f to 127.0.0.1:64825 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 17:55:23,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@14d34529, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 17:55:23,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 17:55:23,947 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39858, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 17:55:23,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5685d47f to 127.0.0.1:64825 2023-02-13 17:55:23,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 17:55:23,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-13 17:55:23,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb-1676310923924 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-13 17:55:23,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure2.ProcedureExecutor(1029): Stored pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-13 17:55:23,958 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-13 17:55:23,958 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=86, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1676311523958 2023-02-13 17:55:23,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb-1676310923924 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-13 17:55:23,959 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb-1676310923924 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-02-13 17:55:23,960 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=86, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-13 17:55:23,960 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-02-13 17:55:23,961 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=86, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 4 msec 2023-02-13 17:55:23,961 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-02-13 17:55:23,962 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=87, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED; timeout=600000, timestamp=1676311523962 2023-02-13 17:55:23,964 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb-1676310923924 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-02-13 17:55:23,964 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-13 17:55:24,064 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 17:55:24,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1676310923924 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-13 17:55:24,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1676310923924 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-13 17:55:24,068 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-13 17:55:24,268 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 17:55:24,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1676310923924 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-13 17:55:24,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1676310923924 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-13 17:55:24,269 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-13 17:55:24,372 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb-1676310923924 2023-02-13 17:55:24,372 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb-1676310923924' 2023-02-13 17:55:24,372 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 17:55:24,372 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb-1676310923924' starting 'acquire' 2023-02-13 17:55:24,372 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb-1676310923924', kicking off acquire phase on members. 2023-02-13 17:55:24,373 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1676310923924 2023-02-13 17:55:24,373 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb-1676310923924 2023-02-13 17:55:24,374 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 17:55:24,374 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb-1676310923924/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:24,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 17:55:24,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 17:55:24,374 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb-1676310923924/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:24,374 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:55:24,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb-1676310923924 2023-02-13 17:55:24,375 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1676310923924 2023-02-13 17:55:24,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-13 17:55:24,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb-1676310923924 2023-02-13 17:55:24,375 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb-1676310923924 from table testCompactionWithHFileLink type FLUSH 2023-02-13 17:55:24,377 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb-1676310923924 2023-02-13 17:55:24,377 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb-1676310923924' with timeout 300000ms 2023-02-13 17:55:24,377 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 17:55:24,377 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb-1676310923924' starting 'acquire' stage 2023-02-13 17:55:24,377 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb-1676310923924' locally acquired 2023-02-13 17:55:24,377 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (snaptb-1676310923924) in zk 2023-02-13 17:55:24,379 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1676310923924/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:24,379 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb-1676310923924 2023-02-13 17:55:24,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb-1676310923924/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:24,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:55:24,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 17:55:24,380 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1676310923924 2023-02-13 17:55:24,380 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb-1676310923924' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:55:24,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:55:24,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:55:24,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1676310923924 2023-02-13 17:55:24,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:24,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:55:24,381 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'snaptb-1676310923924' on coordinator 2023-02-13 17:55:24,381 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@58636d11[Count = 0] remaining members to acquire global barrier 2023-02-13 17:55:24,381 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb-1676310923924' starting 'in-barrier' execution. 2023-02-13 17:55:24,381 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb-1676310923924 2023-02-13 17:55:24,382 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1676310923924 2023-02-13 17:55:24,382 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb-1676310923924 2023-02-13 17:55:24,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb-1676310923924 2023-02-13 17:55:24,382 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb-1676310923924' received 'reached' from coordinator. 2023-02-13 17:55:24,382 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1676310923924/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:24,383 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:55:24,383 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113. 2023-02-13 17:55:24,383 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81. 2023-02-13 17:55:24,383 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911. 2023-02-13 17:55:24,383 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 3 regions 2023-02-13 17:55:24,383 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-13 17:55:24,384 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113. started... 2023-02-13 17:55:24,384 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81. started... 2023-02-13 17:55:24,384 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911. started... 2023-02-13 17:55:24,384 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for feb7d9eaf104f779ab1be2f45a76a113: 2023-02-13 17:55:24,384 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for bb026d2891c65ad4947af9cdbd2aee81: 2023-02-13 17:55:24,384 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 3100400af58d7bf345cc01ad0d304911: 2023-02-13 17:55:24,385 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81.' region-info for snapshot=snaptb-1676310923924 2023-02-13 17:55:24,385 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113.' region-info for snapshot=snaptb-1676310923924 2023-02-13 17:55:24,385 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911.' region-info for snapshot=snaptb-1676310923924 2023-02-13 17:55:24,390 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 17:55:24,390 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 17:55:24,390 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 17:55:24,536 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(142): Chore: CompactedHFilesCleaner missed its start time 2023-02-13 17:55:24,537 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/e6560096ecd74736bebc5405b1d1b2a3, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/2dbd654356cf49ada19b27aa5ddccb8a, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/29b0fc5b96f14c4bacceeb69a12ebe2c, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/cf51030f8e2f4a669ebdb6d63c1b2f69] hfiles 2023-02-13 17:55:24,537 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/42c1aafe213742ee932d1cd3d96850c5, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/437f6f10fd1b4a209c4b0d4fa2e21fc8, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/097db5b1f29543ab9eb72d6e252351f3, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/e6249c54085e4a9b85698d7cdd4cd6f0] hfiles 2023-02-13 17:55:24,538 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/e6560096ecd74736bebc5405b1d1b2a3 for snapshot=snaptb-1676310923924 2023-02-13 17:55:24,537 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/3e7fe91c378b40949900da15f97302b5, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/3a283a50ba284dc4a28a1af04674d6c4, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/40923e1578564f6f8c56f4a4170ec489, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/75b940759fff45ea81b5b6e255f92641] hfiles 2023-02-13 17:55:24,538 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/42c1aafe213742ee932d1cd3d96850c5 for snapshot=snaptb-1676310923924 2023-02-13 17:55:24,538 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 17:55:24,538 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/3e7fe91c378b40949900da15f97302b5 for snapshot=snaptb-1676310923924 2023-02-13 17:55:24,538 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x61038378 to 127.0.0.1:64825 2023-02-13 17:55:24,538 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 17:55:24,538 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 17:55:24,538 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4259c9a6 to 127.0.0.1:64825 2023-02-13 17:55:24,539 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 17:55:24,539 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x142e346d to 127.0.0.1:64825 2023-02-13 17:55:24,539 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 17:55:24,539 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 17:55:24,539 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3b302e63 to 127.0.0.1:64825 2023-02-13 17:55:24,539 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 17:55:24,543 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/2dbd654356cf49ada19b27aa5ddccb8a for snapshot=snaptb-1676310923924 2023-02-13 17:55:24,543 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/3a283a50ba284dc4a28a1af04674d6c4 for snapshot=snaptb-1676310923924 2023-02-13 17:55:24,543 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/437f6f10fd1b4a209c4b0d4fa2e21fc8 for snapshot=snaptb-1676310923924 2023-02-13 17:55:24,543 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/40923e1578564f6f8c56f4a4170ec489 for snapshot=snaptb-1676310923924 2023-02-13 17:55:24,543 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/29b0fc5b96f14c4bacceeb69a12ebe2c for snapshot=snaptb-1676310923924 2023-02-13 17:55:24,543 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/75b940759fff45ea81b5b6e255f92641 for snapshot=snaptb-1676310923924 2023-02-13 17:55:24,543 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/cf51030f8e2f4a669ebdb6d63c1b2f69 for snapshot=snaptb-1676310923924 2023-02-13 17:55:24,543 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/097db5b1f29543ab9eb72d6e252351f3 for snapshot=snaptb-1676310923924 2023-02-13 17:55:24,543 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/e6249c54085e4a9b85698d7cdd4cd6f0 for snapshot=snaptb-1676310923924 2023-02-13 17:55:24,543 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2/608fde33f61b4c5985d5cd904d692f90, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2/23f1089685c348a29b8ec869d0066855, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2/01097aa7d9cf4f0dbb75cfb2586a0995, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2/833e250a6055443d880f3a93997896df] hfiles 2023-02-13 17:55:24,543 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2/4f54bee9443d4462a705bbaee479b92e, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2/e87955f045b64484847b386ef6899d94, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2/e52fd15b18ae474e807cbc2aedac7040, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2/880a5ba4a8a74bb4b87ae5fa41be4939] hfiles 2023-02-13 17:55:24,543 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2/608fde33f61b4c5985d5cd904d692f90 for snapshot=snaptb-1676310923924 2023-02-13 17:55:24,543 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2/4f54bee9443d4462a705bbaee479b92e for snapshot=snaptb-1676310923924 2023-02-13 17:55:24,543 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2/32c4ec93ee254178b71387a374784c01, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2/8be2efbf57b743b085c80dd2eb0afaa9, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2/46a65080c58e40959b6f072bbd556cb4, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2/e06eec59679249679bbc717b4a660668] hfiles 2023-02-13 17:55:24,543 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2/e87955f045b64484847b386ef6899d94 for snapshot=snaptb-1676310923924 2023-02-13 17:55:24,543 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2/23f1089685c348a29b8ec869d0066855 for snapshot=snaptb-1676310923924 2023-02-13 17:55:24,543 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2/e52fd15b18ae474e807cbc2aedac7040 for snapshot=snaptb-1676310923924 2023-02-13 17:55:24,543 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2/01097aa7d9cf4f0dbb75cfb2586a0995 for snapshot=snaptb-1676310923924 2023-02-13 17:55:24,543 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2/32c4ec93ee254178b71387a374784c01 for snapshot=snaptb-1676310923924 2023-02-13 17:55:24,543 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2/833e250a6055443d880f3a93997896df for snapshot=snaptb-1676310923924 2023-02-13 17:55:24,543 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2/880a5ba4a8a74bb4b87ae5fa41be4939 for snapshot=snaptb-1676310923924 2023-02-13 17:55:24,543 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2/8be2efbf57b743b085c80dd2eb0afaa9 for snapshot=snaptb-1676310923924 2023-02-13 17:55:24,543 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2/46a65080c58e40959b6f072bbd556cb4 for snapshot=snaptb-1676310923924 2023-02-13 17:55:24,543 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2/e06eec59679249679bbc717b4a660668 for snapshot=snaptb-1676310923924 2023-02-13 17:55:24,569 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 17:55:24,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1676310923924 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-13 17:55:24,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1676310923924 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-13 17:55:24,570 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-13 17:55:24,952 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81. completed. 2023-02-13 17:55:24,952 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81. 2023-02-13 17:55:24,952 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911. completed. 2023-02-13 17:55:24,953 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911. 2023-02-13 17:55:24,953 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113. completed. 2023-02-13 17:55:24,953 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113. 2023-02-13 17:55:24,953 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/3 local region snapshots. 2023-02-13 17:55:24,953 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/3 local region snapshots. 2023-02-13 17:55:24,953 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/3 local region snapshots. 2023-02-13 17:55:24,953 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 3 local region snapshots. 2023-02-13 17:55:24,953 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:24,953 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb-1676310923924' locally completed 2023-02-13 17:55:24,953 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb-1676310923924' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:55:24,955 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb-1676310923924' has notified controller of completion 2023-02-13 17:55:24,955 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1676310923924/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:24,955 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:55:24,956 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb-1676310923924' completed. 2023-02-13 17:55:24,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb-1676310923924/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:24,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:55:24,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 17:55:24,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:55:24,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:55:24,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1676310923924 2023-02-13 17:55:24,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:24,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:55:24,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1676310923924 2023-02-13 17:55:24,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:24,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb-1676310923924' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:55:24,958 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'snaptb-1676310923924', counting down latch. Waiting for 0 more 2023-02-13 17:55:24,958 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb-1676310923924' execution completed 2023-02-13 17:55:24,958 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:55:24,958 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:55:24,958 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb-1676310923924 2023-02-13 17:55:24,958 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb-1676310923924including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-13 17:55:24,959 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1676310923924 2023-02-13 17:55:24,959 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1676310923924 2023-02-13 17:55:24,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb-1676310923924 2023-02-13 17:55:24,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb-1676310923924 2023-02-13 17:55:24,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:55:24,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 17:55:24,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1676310923924 2023-02-13 17:55:24,959 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 17:55:24,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 17:55:24,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:55:24,960 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb-1676310923924/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:24,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 17:55:24,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1676310923924 2023-02-13 17:55:24,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1676310923924 2023-02-13 17:55:24,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:55:24,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1676310923924 2023-02-13 17:55:24,961 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb-1676310923924/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:24,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:24,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:55:24,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1676310923924 2023-02-13 17:55:24,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:24,962 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1676310923924/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:24,962 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 17:55:24,962 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1676310923924 2023-02-13 17:55:24,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 17:55:24,962 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:55:24,962 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb-1676310923924 2023-02-13 17:55:24,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 17:55:24,963 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testCompactionWithHFileLink 2023-02-13 17:55:24,962 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1676310923924 2023-02-13 17:55:24,962 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 17:55:24,963 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 0e7b6fa9e81bd62588edd7d77d6165e4, NAME => 'testCompactionWithHFileLink,.mob,0.0e7b6fa9e81bd62588edd7d77d6165e4.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb-1676310923924 2023-02-13 17:55:24,963 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1676310923924/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:24,963 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-02-13 17:55:24,963 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1676310923924 2023-02-13 17:55:24,963 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1676310923924 2023-02-13 17:55:24,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 17:55:24,963 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1676310923924 2023-02-13 17:55:24,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 17:55:24,964 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302137eee19f62fc045d89ef731f1c9530586, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302139d7d463af0d4438b8241da37c0ba0354, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213dbd37ffc9d744d64b5e96b9ce742d460, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213fc2538b358534706a24fbf98242dfa71, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302137a1f3d451d5c4326baf651a772ecb753, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302137ce51ed0124b4c47be89d64a62b4981b, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230213a4cfd932ee82497b8b48fce3a3315d3a, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230213ee3933dd70424d2e834718749ce3b857, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213229fa23ca4364d5cbdb41b54922fba45, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023021396722928928e4a41a06aa70fc6c582a1, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213a359d3362aaa4dcd968c7b94fd314224, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213c31399a9990c4a3c804dfe04b8369883] mob files 2023-02-13 17:55:24,964 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302137eee19f62fc045d89ef731f1c9530586 2023-02-13 17:55:24,964 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302139d7d463af0d4438b8241da37c0ba0354 2023-02-13 17:55:24,964 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213dbd37ffc9d744d64b5e96b9ce742d460 2023-02-13 17:55:24,964 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213fc2538b358534706a24fbf98242dfa71 2023-02-13 17:55:24,964 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302137a1f3d451d5c4326baf651a772ecb753 2023-02-13 17:55:24,964 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302137ce51ed0124b4c47be89d64a62b4981b 2023-02-13 17:55:24,964 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230213a4cfd932ee82497b8b48fce3a3315d3a 2023-02-13 17:55:24,964 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230213ee3933dd70424d2e834718749ce3b857 2023-02-13 17:55:24,964 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213229fa23ca4364d5cbdb41b54922fba45 2023-02-13 17:55:24,964 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023021396722928928e4a41a06aa70fc6c582a1 2023-02-13 17:55:24,964 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213a359d3362aaa4dcd968c7b94fd314224 2023-02-13 17:55:24,964 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213c31399a9990c4a3c804dfe04b8369883 2023-02-13 17:55:24,965 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213082c4da7bd0d4f7f9c8784d8b945ad1b, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023021320dc1eb6d4724a889be45ca3e3146c4f, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023021379b796fff0374d62ad0e395fdddd106b, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213fa36eef8827840ccb1f6f6e87f5dbeb0, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213705bed6eac8c49e1a5117e8b5b3398e2, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021374f9927dd8c94d258aa4b2f117e9d6d1, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213c3d4c88cedc34985b4a632a97934ed48, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213e61b7b133da1408695c38873c776d0f7, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302130e6f46dd9ee54f61b0b7f5bacda45b0f, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230213503e4be7eff3436cb2a36ee7d435aee7, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023021351acaee0ed8b40278ec2b3f56036883b, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023021382fd91fd47aa4c0fbaf7ed083a913a76] mob files 2023-02-13 17:55:24,965 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213082c4da7bd0d4f7f9c8784d8b945ad1b 2023-02-13 17:55:24,965 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023021320dc1eb6d4724a889be45ca3e3146c4f 2023-02-13 17:55:24,965 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023021379b796fff0374d62ad0e395fdddd106b 2023-02-13 17:55:24,965 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213fa36eef8827840ccb1f6f6e87f5dbeb0 2023-02-13 17:55:24,965 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213705bed6eac8c49e1a5117e8b5b3398e2 2023-02-13 17:55:24,965 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021374f9927dd8c94d258aa4b2f117e9d6d1 2023-02-13 17:55:24,966 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213c3d4c88cedc34985b4a632a97934ed48 2023-02-13 17:55:24,966 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213e61b7b133da1408695c38873c776d0f7 2023-02-13 17:55:24,966 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302130e6f46dd9ee54f61b0b7f5bacda45b0f 2023-02-13 17:55:24,966 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230213503e4be7eff3436cb2a36ee7d435aee7 2023-02-13 17:55:24,966 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023021351acaee0ed8b40278ec2b3f56036883b 2023-02-13 17:55:24,966 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023021382fd91fd47aa4c0fbaf7ed083a913a76 2023-02-13 17:55:25,071 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 17:55:25,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1676310923924 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-13 17:55:25,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1676310923924 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-13 17:55:25,072 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-13 17:55:25,371 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb-1676310923924 2023-02-13 17:55:25,372 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.hbase-snapshot/.tmp/snaptb-1676310923924 2023-02-13 17:55:25,814 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.hbase-snapshot/.tmp/snaptb-1676310923924 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.hbase-snapshot/snaptb-1676310923924 2023-02-13 17:55:25,838 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb-1676310923924 of table testCompactionWithHFileLink completed 2023-02-13 17:55:25,838 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.hbase-snapshot/.tmp/snaptb-1676310923924 2023-02-13 17:55:25,838 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.hbase-snapshot/.tmp/snaptb-1676310923924 2023-02-13 17:55:25,838 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb-1676310923924 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1676310923959Completed referencing HFiles for the mob region of table: testCompactionWithHFileLink at 1676310925370 (+1411 ms)Consolidate snapshot: snaptb-1676310923924 at 1676310925370Loading Region manifests for snaptb-1676310923924 at 1676310925371 (+1 ms)Writing data manifest for snaptb-1676310923924 at 1676310925381 (+10 ms)Verifying snapshot: snaptb-1676310923924 at 1676310925787 (+406 ms)Snapshot snaptb-1676310923924 of table testCompactionWithHFileLink completed at 1676310925838 (+51 ms) 2023-02-13 17:55:25,840 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=87, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-02-13 17:55:25,841 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=87, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED in 1.8800 sec 2023-02-13 17:55:26,072 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 17:55:26,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1676310923924 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-13 17:55:26,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb-1676310923924 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-13 17:55:26,100 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:55:26,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-02-13 17:55:26,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-13 17:55:26,102 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-13 17:55:26,102 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:55:26,102 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-13 17:55:26,102 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-13 17:55:26,102 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 17:55:26,102 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 17:55:26,104 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:55:26,104 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:26,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:55:26,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:55:26,104 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:26,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 17:55:26,104 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:55:26,104 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 17:55:26,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:55:26,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 17:55:26,105 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-13 17:55:26,105 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-13 17:55:26,105 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-13 17:55:26,105 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:55:26,105 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-13 17:55:26,107 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113. 2023-02-13 17:55:26,107 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81. 2023-02-13 17:55:26,107 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911. 2023-02-13 17:55:26,107 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81. started... 2023-02-13 17:55:26,107 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113. started... 2023-02-13 17:55:26,107 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 17:55:26,107 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:55:26,107 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing feb7d9eaf104f779ab1be2f45a76a113 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-13 17:55:26,107 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing bb026d2891c65ad4947af9cdbd2aee81 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-13 17:55:26,107 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911. started... 2023-02-13 17:55:26,107 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 3100400af58d7bf345cc01ad0d304911 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-13 17:55:26,526 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/.tmp/family1/6638fc4af1744fbba03b41dc2547989b 2023-02-13 17:55:26,529 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/.tmp/family1/edc9c800db0d464cbf669d078286589c 2023-02-13 17:55:26,529 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6638fc4af1744fbba03b41dc2547989b 2023-02-13 17:55:26,533 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for edc9c800db0d464cbf669d078286589c 2023-02-13 17:55:26,926 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/.tmp/family1/66ef95b1806e422382de51cf620c3865 2023-02-13 17:55:26,929 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 66ef95b1806e422382de51cf620c3865 2023-02-13 17:55:26,950 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/.tmp/family2/dfaee0da4613469689db9a3af9bc3098 2023-02-13 17:55:26,953 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dfaee0da4613469689db9a3af9bc3098 2023-02-13 17:55:26,953 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/.tmp/family1/6638fc4af1744fbba03b41dc2547989b as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/6638fc4af1744fbba03b41dc2547989b 2023-02-13 17:55:26,956 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6638fc4af1744fbba03b41dc2547989b 2023-02-13 17:55:26,956 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/6638fc4af1744fbba03b41dc2547989b, entries=3, sequenceid=24, filesize=5.0 K 2023-02-13 17:55:26,957 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/.tmp/family2/dfaee0da4613469689db9a3af9bc3098 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2/dfaee0da4613469689db9a3af9bc3098 2023-02-13 17:55:26,960 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dfaee0da4613469689db9a3af9bc3098 2023-02-13 17:55:26,960 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2/dfaee0da4613469689db9a3af9bc3098, entries=1, sequenceid=24, filesize=5.0 K 2023-02-13 17:55:26,961 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for feb7d9eaf104f779ab1be2f45a76a113 in 854ms, sequenceid=24, compaction requested=true 2023-02-13 17:55:26,961 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for feb7d9eaf104f779ab1be2f45a76a113: 2023-02-13 17:55:26,961 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113. 2023-02-13 17:55:26,961 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 17:55:27,350 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/.tmp/family2/c22a57a9665c42ff9aa3dcb85df20a73 2023-02-13 17:55:27,353 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c22a57a9665c42ff9aa3dcb85df20a73 2023-02-13 17:55:27,353 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/.tmp/family1/edc9c800db0d464cbf669d078286589c as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/edc9c800db0d464cbf669d078286589c 2023-02-13 17:55:27,356 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for edc9c800db0d464cbf669d078286589c 2023-02-13 17:55:27,357 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/edc9c800db0d464cbf669d078286589c, entries=3, sequenceid=24, filesize=5.0 K 2023-02-13 17:55:27,357 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/.tmp/family2/c22a57a9665c42ff9aa3dcb85df20a73 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2/c22a57a9665c42ff9aa3dcb85df20a73 2023-02-13 17:55:27,360 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c22a57a9665c42ff9aa3dcb85df20a73 2023-02-13 17:55:27,360 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2/c22a57a9665c42ff9aa3dcb85df20a73, entries=1, sequenceid=24, filesize=5.0 K 2023-02-13 17:55:27,361 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 3100400af58d7bf345cc01ad0d304911 in 1254ms, sequenceid=24, compaction requested=true 2023-02-13 17:55:27,361 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 3100400af58d7bf345cc01ad0d304911: 2023-02-13 17:55:27,361 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911. 2023-02-13 17:55:27,361 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 17:55:27,741 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/.tmp/family2/2a8846218d484df796ab15abacf34f12 2023-02-13 17:55:27,744 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2a8846218d484df796ab15abacf34f12 2023-02-13 17:55:27,745 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/.tmp/family1/66ef95b1806e422382de51cf620c3865 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/66ef95b1806e422382de51cf620c3865 2023-02-13 17:55:27,748 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 66ef95b1806e422382de51cf620c3865 2023-02-13 17:55:27,748 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/66ef95b1806e422382de51cf620c3865, entries=3, sequenceid=24, filesize=5.0 K 2023-02-13 17:55:27,749 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/.tmp/family2/2a8846218d484df796ab15abacf34f12 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2/2a8846218d484df796ab15abacf34f12 2023-02-13 17:55:27,752 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2a8846218d484df796ab15abacf34f12 2023-02-13 17:55:27,752 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2/2a8846218d484df796ab15abacf34f12, entries=1, sequenceid=24, filesize=5.0 K 2023-02-13 17:55:27,753 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for bb026d2891c65ad4947af9cdbd2aee81 in 1646ms, sequenceid=24, compaction requested=true 2023-02-13 17:55:27,753 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for bb026d2891c65ad4947af9cdbd2aee81: 2023-02-13 17:55:27,753 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81. 2023-02-13 17:55:27,753 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 17:55:27,753 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 17:55:27,753 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:27,753 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-13 17:55:27,753 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-13 17:55:27,755 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:27,755 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 17:55:27,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:27,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:55:27,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:55:27,755 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 17:55:27,755 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:55:27,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:55:27,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:55:27,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 17:55:27,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:27,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:55:27,756 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-13 17:55:27,757 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4cb7c88f[Count = 0] remaining members to acquire global barrier 2023-02-13 17:55:27,757 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-13 17:55:27,757 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 17:55:27,761 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 17:55:27,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 17:55:27,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 17:55:27,761 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-13 17:55:27,761 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-13 17:55:27,761 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:55:27,761 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:27,762 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:55:27,762 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-13 17:55:27,763 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:55:27,762 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:27,763 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-13 17:55:27,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:27,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:55:27,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:55:27,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:55:27,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:55:27,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 17:55:27,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:27,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:55:27,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 17:55:27,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:27,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:55:27,764 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-13 17:55:27,764 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-13 17:55:27,765 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:55:27,765 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:55:27,765 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-13 17:55:27,765 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:55:27,766 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 17:55:27,766 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 17:55:27,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 17:55:27,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:55:27,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:55:27,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 17:55:27,766 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:55:27,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 17:55:27,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:55:27,766 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:27,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:55:27,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:55:27,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 17:55:27,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 17:55:27,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:55:27,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 17:55:27,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:27,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:55:27,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 17:55:27,768 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:27,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:27,771 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:27,771 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:55:27,771 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 17:55:27,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:55:27,771 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-13 17:55:27,771 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:55:27,771 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:55:27,771 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 17:55:27,771 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:55:27,771 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:27,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:55:27,771 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 17:55:27,771 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-13 17:55:27,771 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 17:55:27,771 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:55:27,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:55:27,771 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 17:55:27,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:55:27,871 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:55:27,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:55:27,873 DEBUG [Listener at localhost/35343] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 17:55:27,873 DEBUG [Listener at localhost/35343] regionserver.HStore(1912): feb7d9eaf104f779ab1be2f45a76a113/family1 is initiating major compaction (all files) 2023-02-13 17:55:27,873 INFO [Listener at localhost/35343] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 17:55:27,873 INFO [Listener at localhost/35343] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 17:55:27,873 INFO [Listener at localhost/35343] regionserver.HRegion(2258): Starting compaction of feb7d9eaf104f779ab1be2f45a76a113/family1 in testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113. 2023-02-13 17:55:27,873 INFO [Listener at localhost/35343] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/42c1aafe213742ee932d1cd3d96850c5, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/437f6f10fd1b4a209c4b0d4fa2e21fc8, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/097db5b1f29543ab9eb72d6e252351f3, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/e6249c54085e4a9b85698d7cdd4cd6f0, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/6638fc4af1744fbba03b41dc2547989b] into tmpdir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/.tmp, totalSize=26.7 K 2023-02-13 17:55:27,874 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting 42c1aafe213742ee932d1cd3d96850c5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676310916769 2023-02-13 17:55:27,874 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting 437f6f10fd1b4a209c4b0d4fa2e21fc8, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676310918551 2023-02-13 17:55:27,875 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting 097db5b1f29543ab9eb72d6e252351f3, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676310920347 2023-02-13 17:55:27,875 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting e6249c54085e4a9b85698d7cdd4cd6f0, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676310922143 2023-02-13 17:55:27,875 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting 6638fc4af1744fbba03b41dc2547989b, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-13 17:55:27,887 INFO [Listener at localhost/35343] throttle.PressureAwareThroughputController(145): feb7d9eaf104f779ab1be2f45a76a113#family1#compaction#108 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 17:55:28,295 INFO [Listener at localhost/35343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202302139d6240fea21f4b60961329ee609ed025_del 2023-02-13 17:55:28,295 INFO [Listener at localhost/35343] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302139d6240fea21f4b60961329ee609ed025_del to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302139d6240fea21f4b60961329ee609ed025_del 2023-02-13 17:55:29,108 INFO [Listener at localhost/35343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for baf3b9f07d2a4bac8e1d4543c1dc7cb4 2023-02-13 17:55:29,109 DEBUG [Listener at localhost/35343] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/.tmp/family1/baf3b9f07d2a4bac8e1d4543c1dc7cb4 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/baf3b9f07d2a4bac8e1d4543c1dc7cb4 2023-02-13 17:55:29,112 INFO [Listener at localhost/35343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for baf3b9f07d2a4bac8e1d4543c1dc7cb4 2023-02-13 17:55:29,113 INFO [Listener at localhost/35343] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in feb7d9eaf104f779ab1be2f45a76a113/family1 of feb7d9eaf104f779ab1be2f45a76a113 into baf3b9f07d2a4bac8e1d4543c1dc7cb4(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 17:55:29,113 DEBUG [Listener at localhost/35343] regionserver.HRegion(2288): Compaction status journal for feb7d9eaf104f779ab1be2f45a76a113: 2023-02-13 17:55:29,113 DEBUG [Listener at localhost/35343] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 17:55:29,113 DEBUG [Listener at localhost/35343] regionserver.HStore(1912): feb7d9eaf104f779ab1be2f45a76a113/family2 is initiating major compaction (all files) 2023-02-13 17:55:29,113 INFO [Listener at localhost/35343] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 17:55:29,113 INFO [Listener at localhost/35343] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 17:55:29,113 INFO [Listener at localhost/35343] regionserver.HRegion(2258): Starting compaction of feb7d9eaf104f779ab1be2f45a76a113/family2 in testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113. 2023-02-13 17:55:29,114 INFO [Listener at localhost/35343] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2/4f54bee9443d4462a705bbaee479b92e, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2/e87955f045b64484847b386ef6899d94, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2/e52fd15b18ae474e807cbc2aedac7040, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2/880a5ba4a8a74bb4b87ae5fa41be4939, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2/dfaee0da4613469689db9a3af9bc3098] into tmpdir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/.tmp, totalSize=25.4 K 2023-02-13 17:55:29,114 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting 4f54bee9443d4462a705bbaee479b92e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676310916769 2023-02-13 17:55:29,114 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting e87955f045b64484847b386ef6899d94, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676310918551 2023-02-13 17:55:29,114 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting e52fd15b18ae474e807cbc2aedac7040, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676310920347 2023-02-13 17:55:29,115 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting 880a5ba4a8a74bb4b87ae5fa41be4939, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676310922143 2023-02-13 17:55:29,115 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting dfaee0da4613469689db9a3af9bc3098, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-13 17:55:29,125 INFO [Listener at localhost/35343] throttle.PressureAwareThroughputController(145): feb7d9eaf104f779ab1be2f45a76a113#family2#compaction#109 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 17:55:29,138 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/42c1aafe213742ee932d1cd3d96850c5, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/437f6f10fd1b4a209c4b0d4fa2e21fc8, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/097db5b1f29543ab9eb72d6e252351f3, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/e6249c54085e4a9b85698d7cdd4cd6f0, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/6638fc4af1744fbba03b41dc2547989b] to archive 2023-02-13 17:55:29,139 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:55:29,140 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/42c1aafe213742ee932d1cd3d96850c5 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/42c1aafe213742ee932d1cd3d96850c5 2023-02-13 17:55:29,141 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/437f6f10fd1b4a209c4b0d4fa2e21fc8 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/437f6f10fd1b4a209c4b0d4fa2e21fc8 2023-02-13 17:55:29,142 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/097db5b1f29543ab9eb72d6e252351f3 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/097db5b1f29543ab9eb72d6e252351f3 2023-02-13 17:55:29,143 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/e6249c54085e4a9b85698d7cdd4cd6f0 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/e6249c54085e4a9b85698d7cdd4cd6f0 2023-02-13 17:55:29,144 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/6638fc4af1744fbba03b41dc2547989b to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/6638fc4af1744fbba03b41dc2547989b 2023-02-13 17:55:29,533 INFO [Listener at localhost/35343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202302133d32bac7abab49e7a3bd7573e6556bcc_del 2023-02-13 17:55:29,533 INFO [Listener at localhost/35343] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302133d32bac7abab49e7a3bd7573e6556bcc_del to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302133d32bac7abab49e7a3bd7573e6556bcc_del 2023-02-13 17:55:30,346 INFO [Listener at localhost/35343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for df23d4e000124967989628c6bf886a7c 2023-02-13 17:55:30,346 DEBUG [Listener at localhost/35343] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/.tmp/family2/df23d4e000124967989628c6bf886a7c as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2/df23d4e000124967989628c6bf886a7c 2023-02-13 17:55:30,350 INFO [Listener at localhost/35343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for df23d4e000124967989628c6bf886a7c 2023-02-13 17:55:30,351 INFO [Listener at localhost/35343] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in feb7d9eaf104f779ab1be2f45a76a113/family2 of feb7d9eaf104f779ab1be2f45a76a113 into df23d4e000124967989628c6bf886a7c(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 17:55:30,351 DEBUG [Listener at localhost/35343] regionserver.HRegion(2288): Compaction status journal for feb7d9eaf104f779ab1be2f45a76a113: 2023-02-13 17:55:30,351 DEBUG [Listener at localhost/35343] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 17:55:30,351 DEBUG [Listener at localhost/35343] regionserver.HStore(1912): bb026d2891c65ad4947af9cdbd2aee81/family1 is initiating major compaction (all files) 2023-02-13 17:55:30,351 INFO [Listener at localhost/35343] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 17:55:30,351 INFO [Listener at localhost/35343] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 17:55:30,352 INFO [Listener at localhost/35343] regionserver.HRegion(2258): Starting compaction of bb026d2891c65ad4947af9cdbd2aee81/family1 in testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81. 2023-02-13 17:55:30,352 INFO [Listener at localhost/35343] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/3e7fe91c378b40949900da15f97302b5, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/3a283a50ba284dc4a28a1af04674d6c4, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/40923e1578564f6f8c56f4a4170ec489, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/75b940759fff45ea81b5b6e255f92641, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/66ef95b1806e422382de51cf620c3865] into tmpdir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/.tmp, totalSize=26.7 K 2023-02-13 17:55:30,353 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting 3e7fe91c378b40949900da15f97302b5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676310916769 2023-02-13 17:55:30,353 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting 3a283a50ba284dc4a28a1af04674d6c4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676310918550 2023-02-13 17:55:30,353 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting 40923e1578564f6f8c56f4a4170ec489, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676310920347 2023-02-13 17:55:30,353 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting 75b940759fff45ea81b5b6e255f92641, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676310922143 2023-02-13 17:55:30,354 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting 66ef95b1806e422382de51cf620c3865, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-13 17:55:30,362 INFO [Listener at localhost/35343] throttle.PressureAwareThroughputController(145): bb026d2891c65ad4947af9cdbd2aee81#family1#compaction#110 average throughput is 0.85 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 17:55:30,441 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2/4f54bee9443d4462a705bbaee479b92e, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2/e87955f045b64484847b386ef6899d94, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2/e52fd15b18ae474e807cbc2aedac7040, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2/880a5ba4a8a74bb4b87ae5fa41be4939, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2/dfaee0da4613469689db9a3af9bc3098] to archive 2023-02-13 17:55:30,442 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:55:30,443 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2/4f54bee9443d4462a705bbaee479b92e to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2/4f54bee9443d4462a705bbaee479b92e 2023-02-13 17:55:30,444 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2/e87955f045b64484847b386ef6899d94 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2/e87955f045b64484847b386ef6899d94 2023-02-13 17:55:30,445 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2/e52fd15b18ae474e807cbc2aedac7040 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2/e52fd15b18ae474e807cbc2aedac7040 2023-02-13 17:55:30,446 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2/880a5ba4a8a74bb4b87ae5fa41be4939 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2/880a5ba4a8a74bb4b87ae5fa41be4939 2023-02-13 17:55:30,447 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2/dfaee0da4613469689db9a3af9bc3098 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2/dfaee0da4613469689db9a3af9bc3098 2023-02-13 17:55:30,775 INFO [Listener at localhost/35343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202302136f56df509efe4d5aad14a56a15e1d50c_del 2023-02-13 17:55:30,775 INFO [Listener at localhost/35343] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302136f56df509efe4d5aad14a56a15e1d50c_del to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302136f56df509efe4d5aad14a56a15e1d50c_del 2023-02-13 17:55:31,190 INFO [Listener at localhost/35343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 54e7b1341a1f48fbafd4fc8b26200857 2023-02-13 17:55:31,191 DEBUG [Listener at localhost/35343] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/.tmp/family1/54e7b1341a1f48fbafd4fc8b26200857 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/54e7b1341a1f48fbafd4fc8b26200857 2023-02-13 17:55:31,195 INFO [Listener at localhost/35343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 54e7b1341a1f48fbafd4fc8b26200857 2023-02-13 17:55:31,196 INFO [Listener at localhost/35343] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in bb026d2891c65ad4947af9cdbd2aee81/family1 of bb026d2891c65ad4947af9cdbd2aee81 into 54e7b1341a1f48fbafd4fc8b26200857(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 17:55:31,196 DEBUG [Listener at localhost/35343] regionserver.HRegion(2288): Compaction status journal for bb026d2891c65ad4947af9cdbd2aee81: 2023-02-13 17:55:31,196 DEBUG [Listener at localhost/35343] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 17:55:31,196 DEBUG [Listener at localhost/35343] regionserver.HStore(1912): bb026d2891c65ad4947af9cdbd2aee81/family2 is initiating major compaction (all files) 2023-02-13 17:55:31,197 INFO [Listener at localhost/35343] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 17:55:31,197 INFO [Listener at localhost/35343] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 17:55:31,197 INFO [Listener at localhost/35343] regionserver.HRegion(2258): Starting compaction of bb026d2891c65ad4947af9cdbd2aee81/family2 in testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81. 2023-02-13 17:55:31,197 INFO [Listener at localhost/35343] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2/608fde33f61b4c5985d5cd904d692f90, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2/23f1089685c348a29b8ec869d0066855, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2/01097aa7d9cf4f0dbb75cfb2586a0995, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2/833e250a6055443d880f3a93997896df, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2/2a8846218d484df796ab15abacf34f12] into tmpdir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/.tmp, totalSize=25.4 K 2023-02-13 17:55:31,197 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting 608fde33f61b4c5985d5cd904d692f90, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676310916769 2023-02-13 17:55:31,198 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting 23f1089685c348a29b8ec869d0066855, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676310918550 2023-02-13 17:55:31,198 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting 01097aa7d9cf4f0dbb75cfb2586a0995, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676310920347 2023-02-13 17:55:31,198 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting 833e250a6055443d880f3a93997896df, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676310922143 2023-02-13 17:55:31,199 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting 2a8846218d484df796ab15abacf34f12, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-13 17:55:31,209 INFO [Listener at localhost/35343] throttle.PressureAwareThroughputController(145): bb026d2891c65ad4947af9cdbd2aee81#family2#compaction#111 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 17:55:31,237 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/3e7fe91c378b40949900da15f97302b5, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/3a283a50ba284dc4a28a1af04674d6c4, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/40923e1578564f6f8c56f4a4170ec489, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/75b940759fff45ea81b5b6e255f92641, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/66ef95b1806e422382de51cf620c3865] to archive 2023-02-13 17:55:31,238 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:55:31,239 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/3e7fe91c378b40949900da15f97302b5 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/3e7fe91c378b40949900da15f97302b5 2023-02-13 17:55:31,240 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/3a283a50ba284dc4a28a1af04674d6c4 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/3a283a50ba284dc4a28a1af04674d6c4 2023-02-13 17:55:31,241 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/40923e1578564f6f8c56f4a4170ec489 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/40923e1578564f6f8c56f4a4170ec489 2023-02-13 17:55:31,242 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/75b940759fff45ea81b5b6e255f92641 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/75b940759fff45ea81b5b6e255f92641 2023-02-13 17:55:31,243 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/66ef95b1806e422382de51cf620c3865 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/66ef95b1806e422382de51cf620c3865 2023-02-13 17:55:31,617 INFO [Listener at localhost/35343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023021366dcce6f37a14b1085fd6560e8b41d41_del 2023-02-13 17:55:31,617 INFO [Listener at localhost/35343] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021366dcce6f37a14b1085fd6560e8b41d41_del to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023021366dcce6f37a14b1085fd6560e8b41d41_del 2023-02-13 17:55:32,430 INFO [Listener at localhost/35343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for acf7ea1d1aef4fdd8202d04e8125e0e2 2023-02-13 17:55:32,431 DEBUG [Listener at localhost/35343] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/.tmp/family2/acf7ea1d1aef4fdd8202d04e8125e0e2 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2/acf7ea1d1aef4fdd8202d04e8125e0e2 2023-02-13 17:55:32,434 INFO [Listener at localhost/35343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for acf7ea1d1aef4fdd8202d04e8125e0e2 2023-02-13 17:55:32,435 INFO [Listener at localhost/35343] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in bb026d2891c65ad4947af9cdbd2aee81/family2 of bb026d2891c65ad4947af9cdbd2aee81 into acf7ea1d1aef4fdd8202d04e8125e0e2(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 17:55:32,435 DEBUG [Listener at localhost/35343] regionserver.HRegion(2288): Compaction status journal for bb026d2891c65ad4947af9cdbd2aee81: 2023-02-13 17:55:32,435 DEBUG [Listener at localhost/35343] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 17:55:32,435 DEBUG [Listener at localhost/35343] regionserver.HStore(1912): 3100400af58d7bf345cc01ad0d304911/family1 is initiating major compaction (all files) 2023-02-13 17:55:32,435 INFO [Listener at localhost/35343] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 17:55:32,435 INFO [Listener at localhost/35343] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 17:55:32,436 INFO [Listener at localhost/35343] regionserver.HRegion(2258): Starting compaction of 3100400af58d7bf345cc01ad0d304911/family1 in testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911. 2023-02-13 17:55:32,436 INFO [Listener at localhost/35343] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/e6560096ecd74736bebc5405b1d1b2a3, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/2dbd654356cf49ada19b27aa5ddccb8a, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/29b0fc5b96f14c4bacceeb69a12ebe2c, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/cf51030f8e2f4a669ebdb6d63c1b2f69, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/edc9c800db0d464cbf669d078286589c] into tmpdir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/.tmp, totalSize=26.7 K 2023-02-13 17:55:32,436 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting e6560096ecd74736bebc5405b1d1b2a3, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676310916767 2023-02-13 17:55:32,437 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting 2dbd654356cf49ada19b27aa5ddccb8a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676310918550 2023-02-13 17:55:32,437 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2/608fde33f61b4c5985d5cd904d692f90, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2/23f1089685c348a29b8ec869d0066855, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2/01097aa7d9cf4f0dbb75cfb2586a0995, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2/833e250a6055443d880f3a93997896df, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2/2a8846218d484df796ab15abacf34f12] to archive 2023-02-13 17:55:32,437 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting 29b0fc5b96f14c4bacceeb69a12ebe2c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676310920346 2023-02-13 17:55:32,437 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting cf51030f8e2f4a669ebdb6d63c1b2f69, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676310922142 2023-02-13 17:55:32,438 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:55:32,438 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting edc9c800db0d464cbf669d078286589c, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-13 17:55:32,439 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2/608fde33f61b4c5985d5cd904d692f90 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2/608fde33f61b4c5985d5cd904d692f90 2023-02-13 17:55:32,440 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2/23f1089685c348a29b8ec869d0066855 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2/23f1089685c348a29b8ec869d0066855 2023-02-13 17:55:32,442 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2/01097aa7d9cf4f0dbb75cfb2586a0995 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2/01097aa7d9cf4f0dbb75cfb2586a0995 2023-02-13 17:55:32,443 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2/833e250a6055443d880f3a93997896df to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2/833e250a6055443d880f3a93997896df 2023-02-13 17:55:32,445 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2/2a8846218d484df796ab15abacf34f12 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2/2a8846218d484df796ab15abacf34f12 2023-02-13 17:55:32,452 INFO [Listener at localhost/35343] throttle.PressureAwareThroughputController(145): 3100400af58d7bf345cc01ad0d304911#family1#compaction#112 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 17:55:32,860 INFO [Listener at localhost/35343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202302139cb0ed50cfd5464aabdd5837668c8eaf_del 2023-02-13 17:55:32,860 INFO [Listener at localhost/35343] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302139cb0ed50cfd5464aabdd5837668c8eaf_del to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302139cb0ed50cfd5464aabdd5837668c8eaf_del 2023-02-13 17:55:33,673 INFO [Listener at localhost/35343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b471d45800af4cc7b96421696067177a 2023-02-13 17:55:33,674 DEBUG [Listener at localhost/35343] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/.tmp/family1/b471d45800af4cc7b96421696067177a as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/b471d45800af4cc7b96421696067177a 2023-02-13 17:55:33,677 INFO [Listener at localhost/35343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b471d45800af4cc7b96421696067177a 2023-02-13 17:55:33,678 INFO [Listener at localhost/35343] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 3100400af58d7bf345cc01ad0d304911/family1 of 3100400af58d7bf345cc01ad0d304911 into b471d45800af4cc7b96421696067177a(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 17:55:33,678 DEBUG [Listener at localhost/35343] regionserver.HRegion(2288): Compaction status journal for 3100400af58d7bf345cc01ad0d304911: 2023-02-13 17:55:33,678 DEBUG [Listener at localhost/35343] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 17:55:33,678 DEBUG [Listener at localhost/35343] regionserver.HStore(1912): 3100400af58d7bf345cc01ad0d304911/family2 is initiating major compaction (all files) 2023-02-13 17:55:33,678 INFO [Listener at localhost/35343] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 17:55:33,679 INFO [Listener at localhost/35343] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 17:55:33,679 INFO [Listener at localhost/35343] regionserver.HRegion(2258): Starting compaction of 3100400af58d7bf345cc01ad0d304911/family2 in testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911. 2023-02-13 17:55:33,679 INFO [Listener at localhost/35343] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2/32c4ec93ee254178b71387a374784c01, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2/8be2efbf57b743b085c80dd2eb0afaa9, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2/46a65080c58e40959b6f072bbd556cb4, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2/e06eec59679249679bbc717b4a660668, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2/c22a57a9665c42ff9aa3dcb85df20a73] into tmpdir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/.tmp, totalSize=25.4 K 2023-02-13 17:55:33,679 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting 32c4ec93ee254178b71387a374784c01, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676310916767 2023-02-13 17:55:33,679 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting 8be2efbf57b743b085c80dd2eb0afaa9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676310918550 2023-02-13 17:55:33,680 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting 46a65080c58e40959b6f072bbd556cb4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676310920346 2023-02-13 17:55:33,680 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting e06eec59679249679bbc717b4a660668, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676310922142 2023-02-13 17:55:33,680 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting c22a57a9665c42ff9aa3dcb85df20a73, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-13 17:55:33,690 INFO [Listener at localhost/35343] throttle.PressureAwareThroughputController(145): 3100400af58d7bf345cc01ad0d304911#family2#compaction#113 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 17:55:33,737 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/e6560096ecd74736bebc5405b1d1b2a3, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/2dbd654356cf49ada19b27aa5ddccb8a, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/29b0fc5b96f14c4bacceeb69a12ebe2c, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/cf51030f8e2f4a669ebdb6d63c1b2f69, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/edc9c800db0d464cbf669d078286589c] to archive 2023-02-13 17:55:33,738 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:55:33,739 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/e6560096ecd74736bebc5405b1d1b2a3 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/e6560096ecd74736bebc5405b1d1b2a3 2023-02-13 17:55:33,740 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/2dbd654356cf49ada19b27aa5ddccb8a to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/2dbd654356cf49ada19b27aa5ddccb8a 2023-02-13 17:55:33,741 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/29b0fc5b96f14c4bacceeb69a12ebe2c to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/29b0fc5b96f14c4bacceeb69a12ebe2c 2023-02-13 17:55:33,742 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/cf51030f8e2f4a669ebdb6d63c1b2f69 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/cf51030f8e2f4a669ebdb6d63c1b2f69 2023-02-13 17:55:33,743 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/edc9c800db0d464cbf669d078286589c to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/edc9c800db0d464cbf669d078286589c 2023-02-13 17:55:34,097 INFO [Listener at localhost/35343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202302138c71a59c6e57428494d2b19585b18f40_del 2023-02-13 17:55:34,098 INFO [Listener at localhost/35343] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302138c71a59c6e57428494d2b19585b18f40_del to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302138c71a59c6e57428494d2b19585b18f40_del 2023-02-13 17:55:34,911 INFO [Listener at localhost/35343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9917cda15f294cd1a9c62b69068cefca 2023-02-13 17:55:34,912 DEBUG [Listener at localhost/35343] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/.tmp/family2/9917cda15f294cd1a9c62b69068cefca as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2/9917cda15f294cd1a9c62b69068cefca 2023-02-13 17:55:34,915 INFO [Listener at localhost/35343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9917cda15f294cd1a9c62b69068cefca 2023-02-13 17:55:34,916 INFO [Listener at localhost/35343] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 3100400af58d7bf345cc01ad0d304911/family2 of 3100400af58d7bf345cc01ad0d304911 into 9917cda15f294cd1a9c62b69068cefca(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 17:55:34,916 DEBUG [Listener at localhost/35343] regionserver.HRegion(2288): Compaction status journal for 3100400af58d7bf345cc01ad0d304911: 2023-02-13 17:55:34,921 DEBUG [Listener at localhost/35343] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 17:55:34,924 DEBUG [Listener at localhost/35343] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 17:55:34,930 DEBUG [Listener at localhost/35343] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 17:55:34,931 DEBUG [Listener at localhost/35343] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 17:55:34,937 INFO [Listener at localhost/35343] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-13 17:55:34,942 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2/32c4ec93ee254178b71387a374784c01, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2/8be2efbf57b743b085c80dd2eb0afaa9, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2/46a65080c58e40959b6f072bbd556cb4, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2/e06eec59679249679bbc717b4a660668, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2/c22a57a9665c42ff9aa3dcb85df20a73] to archive 2023-02-13 17:55:34,943 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:55:34,944 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2/32c4ec93ee254178b71387a374784c01 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2/32c4ec93ee254178b71387a374784c01 2023-02-13 17:55:34,945 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2/8be2efbf57b743b085c80dd2eb0afaa9 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2/8be2efbf57b743b085c80dd2eb0afaa9 2023-02-13 17:55:34,946 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2/46a65080c58e40959b6f072bbd556cb4 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2/46a65080c58e40959b6f072bbd556cb4 2023-02-13 17:55:34,948 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2/e06eec59679249679bbc717b4a660668 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2/e06eec59679249679bbc717b4a660668 2023-02-13 17:55:34,949 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2/c22a57a9665c42ff9aa3dcb85df20a73 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2/c22a57a9665c42ff9aa3dcb85df20a73 2023-02-13 17:55:34,972 INFO [Listener at localhost/35343] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-02-13 17:55:34,975 INFO [Listener at localhost/35343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202302139cb0ed50cfd5464aabdd5837668c8eaf_del 2023-02-13 17:55:34,978 INFO [Listener at localhost/35343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202302136f56df509efe4d5aad14a56a15e1d50c_del 2023-02-13 17:55:34,981 INFO [Listener at localhost/35343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202302139d6240fea21f4b60961329ee609ed025_del 2023-02-13 17:55:34,981 INFO [Listener at localhost/35343] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testCompactionWithHFileLink' column='family1' 2023-02-13 17:55:34,982 DEBUG [Listener at localhost/35343] zookeeper.ReadOnlyZKClient(139): Connect 0x78e7e520 to 127.0.0.1:64825 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 17:55:34,987 DEBUG [Listener at localhost/35343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7f1d5058, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 17:55:34,987 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230213 for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 17:55:34,987 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230213 for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 17:55:34,987 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230213 for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 17:55:35,445 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213513794e59a7b42b4ae5c853362cc12af to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230213513794e59a7b42b4ae5c853362cc12af 2023-02-13 17:55:35,446 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230213 table='testCompactionWithHFileLink' column='family1' 2023-02-13 17:55:35,458 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 17:55:35,461 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52806, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 17:55:35,467 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 17:55:35,469 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43270, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 17:55:35,476 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230213/family1/8cfda9d8630248c9acd3a1b9c23dee9e first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-02-13 17:55:35,477 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113., hostname=jenkins-hbase4.apache.org,38881,1676310818035, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230213/family1/8cfda9d8630248c9acd3a1b9c23dee9e}] 2023-02-13 17:55:35,480 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(763): Validating hfile at hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230213/family1/8cfda9d8630248c9acd3a1b9c23dee9e for inclusion in feb7d9eaf104f779ab1be2f45a76a113/family1 2023-02-13 17:55:35,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-02-13 17:55:35,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-13 17:55:35,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegion(2445): Flush status journal for feb7d9eaf104f779ab1be2f45a76a113: 2023-02-13 17:55:35,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230213/family1/8cfda9d8630248c9acd3a1b9c23dee9e to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testCompactionWithHFileLink__mlcsurj9d24fvgp8kn0qem2dp1mpcpejju63solrsfi1pmk70ga8oh0mg3ilseco/family1/8cfda9d8630248c9acd3a1b9c23dee9e 2023-02-13 17:55:35,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testCompactionWithHFileLink__mlcsurj9d24fvgp8kn0qem2dp1mpcpejju63solrsfi1pmk70ga8oh0mg3ilseco/family1/8cfda9d8630248c9acd3a1b9c23dee9e as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/0b449e2574bb4535a04842953bc68169_SeqId_29_ 2023-02-13 17:55:35,485 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(849): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testCompactionWithHFileLink__mlcsurj9d24fvgp8kn0qem2dp1mpcpejju63solrsfi1pmk70ga8oh0mg3ilseco/family1/8cfda9d8630248c9acd3a1b9c23dee9e into feb7d9eaf104f779ab1be2f45a76a113/family1 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/0b449e2574bb4535a04842953bc68169_SeqId_29_ - updating store file list. 2023-02-13 17:55:35,488 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(882): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/0b449e2574bb4535a04842953bc68169_SeqId_29_ into feb7d9eaf104f779ab1be2f45a76a113/family1 2023-02-13 17:55:35,489 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(855): Successfully loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testCompactionWithHFileLink__mlcsurj9d24fvgp8kn0qem2dp1mpcpejju63solrsfi1pmk70ga8oh0mg3ilseco/family1/8cfda9d8630248c9acd3a1b9c23dee9e into feb7d9eaf104f779ab1be2f45a76a113/family1 (new location: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/0b449e2574bb4535a04842953bc68169_SeqId_29_) 2023-02-13 17:55:35,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testCompactionWithHFileLink__mlcsurj9d24fvgp8kn0qem2dp1mpcpejju63solrsfi1pmk70ga8oh0mg3ilseco/family1/8cfda9d8630248c9acd3a1b9c23dee9e 2023-02-13 17:55:35,491 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230213 table='testCompactionWithHFileLink' column='family1' 2023-02-13 17:55:35,491 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:55:35,492 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302137a1f3d451d5c4326baf651a772ecb753 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302137a1f3d451d5c4326baf651a772ecb753 2023-02-13 17:55:35,493 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302137ce51ed0124b4c47be89d64a62b4981b to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302137ce51ed0124b4c47be89d64a62b4981b 2023-02-13 17:55:35,494 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230213a4cfd932ee82497b8b48fce3a3315d3a to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230213a4cfd932ee82497b8b48fce3a3315d3a 2023-02-13 17:55:35,495 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230213ee3933dd70424d2e834718749ce3b857 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230213ee3933dd70424d2e834718749ce3b857 2023-02-13 17:55:35,495 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-13 17:55:35,495 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230213' 2023-02-13 17:55:35,495 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230213 for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 17:55:35,839 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021312a83c6dea5d4129aaf513ab029e2873 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023021312a83c6dea5d4129aaf513ab029e2873 2023-02-13 17:55:35,840 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230213 table='testCompactionWithHFileLink' column='family1' 2023-02-13 17:55:35,843 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213dd6c5a22d69a49f3b6e8f27d82548c9a to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213dd6c5a22d69a49f3b6e8f27d82548c9a 2023-02-13 17:55:35,844 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230213 table='testCompactionWithHFileLink' column='family1' 2023-02-13 17:55:35,865 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230213/family1/1bfe4a0e35494220803b5f5ba705e465 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-02-13 17:55:35,867 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81., hostname=jenkins-hbase4.apache.org,38881,1676310818035, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230213/family1/1bfe4a0e35494220803b5f5ba705e465}] 2023-02-13 17:55:35,869 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(763): Validating hfile at hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230213/family1/1bfe4a0e35494220803b5f5ba705e465 for inclusion in bb026d2891c65ad4947af9cdbd2aee81/family1 2023-02-13 17:55:35,869 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230213/family1/47f098795a3447fd89f7b7075348d682 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-02-13 17:55:35,869 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911., hostname=jenkins-hbase4.apache.org,38881,1676310818035, seqNum=2 for row with hfile group [{family1,hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230213/family1/47f098795a3447fd89f7b7075348d682}] 2023-02-13 17:55:35,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-02-13 17:55:35,871 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(763): Validating hfile at hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230213/family1/47f098795a3447fd89f7b7075348d682 for inclusion in 3100400af58d7bf345cc01ad0d304911/family1 2023-02-13 17:55:35,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(777): Region bounds: first=1 last=2 2023-02-13 17:55:35,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegion(2445): Flush status journal for bb026d2891c65ad4947af9cdbd2aee81: 2023-02-13 17:55:35,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230213/family1/1bfe4a0e35494220803b5f5ba705e465 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testCompactionWithHFileLink__sc8f0ltqd69gsr3k7jrvhgep6k3dp9dg70qmlnou2uqqa4gm7hj1g82r959l8qps/family1/1bfe4a0e35494220803b5f5ba705e465 2023-02-13 17:55:35,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-02-13 17:55:35,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(777): Region bounds: first= last=1 2023-02-13 17:55:35,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HRegion(2445): Flush status journal for 3100400af58d7bf345cc01ad0d304911: 2023-02-13 17:55:35,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testCompactionWithHFileLink__sc8f0ltqd69gsr3k7jrvhgep6k3dp9dg70qmlnou2uqqa4gm7hj1g82r959l8qps/family1/1bfe4a0e35494220803b5f5ba705e465 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/93dbe42aa0154b5c8a1159622499de50_SeqId_29_ 2023-02-13 17:55:35,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230213/family1/47f098795a3447fd89f7b7075348d682 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testCompactionWithHFileLink__v08fqq34gaa46h9t84pc1dqe1qchfem39ia23h1m3c1o3plmtnn8al8bch7gf8en/family1/47f098795a3447fd89f7b7075348d682 2023-02-13 17:55:35,876 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(849): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testCompactionWithHFileLink__sc8f0ltqd69gsr3k7jrvhgep6k3dp9dg70qmlnou2uqqa4gm7hj1g82r959l8qps/family1/1bfe4a0e35494220803b5f5ba705e465 into bb026d2891c65ad4947af9cdbd2aee81/family1 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/93dbe42aa0154b5c8a1159622499de50_SeqId_29_ - updating store file list. 2023-02-13 17:55:35,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testCompactionWithHFileLink__v08fqq34gaa46h9t84pc1dqe1qchfem39ia23h1m3c1o3plmtnn8al8bch7gf8en/family1/47f098795a3447fd89f7b7075348d682 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/6a1dff472f27430aa21635d58421cf2d_SeqId_29_ 2023-02-13 17:55:35,879 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(849): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testCompactionWithHFileLink__v08fqq34gaa46h9t84pc1dqe1qchfem39ia23h1m3c1o3plmtnn8al8bch7gf8en/family1/47f098795a3447fd89f7b7075348d682 into 3100400af58d7bf345cc01ad0d304911/family1 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/6a1dff472f27430aa21635d58421cf2d_SeqId_29_ - updating store file list. 2023-02-13 17:55:35,880 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(882): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/93dbe42aa0154b5c8a1159622499de50_SeqId_29_ into bb026d2891c65ad4947af9cdbd2aee81/family1 2023-02-13 17:55:35,880 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(855): Successfully loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testCompactionWithHFileLink__sc8f0ltqd69gsr3k7jrvhgep6k3dp9dg70qmlnou2uqqa4gm7hj1g82r959l8qps/family1/1bfe4a0e35494220803b5f5ba705e465 into bb026d2891c65ad4947af9cdbd2aee81/family1 (new location: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/93dbe42aa0154b5c8a1159622499de50_SeqId_29_) 2023-02-13 17:55:35,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testCompactionWithHFileLink__sc8f0ltqd69gsr3k7jrvhgep6k3dp9dg70qmlnou2uqqa4gm7hj1g82r959l8qps/family1/1bfe4a0e35494220803b5f5ba705e465 2023-02-13 17:55:35,882 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230213 table='testCompactionWithHFileLink' column='family1' 2023-02-13 17:55:35,882 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(882): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/6a1dff472f27430aa21635d58421cf2d_SeqId_29_ into 3100400af58d7bf345cc01ad0d304911/family1 2023-02-13 17:55:35,882 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(855): Successfully loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testCompactionWithHFileLink__v08fqq34gaa46h9t84pc1dqe1qchfem39ia23h1m3c1o3plmtnn8al8bch7gf8en/family1/47f098795a3447fd89f7b7075348d682 into 3100400af58d7bf345cc01ad0d304911/family1 (new location: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/6a1dff472f27430aa21635d58421cf2d_SeqId_29_) 2023-02-13 17:55:35,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testCompactionWithHFileLink__v08fqq34gaa46h9t84pc1dqe1qchfem39ia23h1m3c1o3plmtnn8al8bch7gf8en/family1/47f098795a3447fd89f7b7075348d682 2023-02-13 17:55:35,883 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:55:35,884 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302137eee19f62fc045d89ef731f1c9530586 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302137eee19f62fc045d89ef731f1c9530586 2023-02-13 17:55:35,884 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230213 table='testCompactionWithHFileLink' column='family1' 2023-02-13 17:55:35,885 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:55:35,885 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302139d7d463af0d4438b8241da37c0ba0354 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302139d7d463af0d4438b8241da37c0ba0354 2023-02-13 17:55:35,886 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213dbd37ffc9d744d64b5e96b9ce742d460 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213dbd37ffc9d744d64b5e96b9ce742d460 2023-02-13 17:55:35,886 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213229fa23ca4364d5cbdb41b54922fba45 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213229fa23ca4364d5cbdb41b54922fba45 2023-02-13 17:55:35,887 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213fc2538b358534706a24fbf98242dfa71 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213fc2538b358534706a24fbf98242dfa71 2023-02-13 17:55:35,887 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-13 17:55:35,887 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230213' 2023-02-13 17:55:35,887 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023021396722928928e4a41a06aa70fc6c582a1 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023021396722928928e4a41a06aa70fc6c582a1 2023-02-13 17:55:35,888 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230213 for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 17:55:35,888 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213a359d3362aaa4dcd968c7b94fd314224 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213a359d3362aaa4dcd968c7b94fd314224 2023-02-13 17:55:35,889 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213c31399a9990c4a3c804dfe04b8369883 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213c31399a9990c4a3c804dfe04b8369883 2023-02-13 17:55:35,889 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-13 17:55:35,889 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230213' 2023-02-13 17:55:35,890 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230213 for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 17:55:35,890 INFO [Listener at localhost/35343] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-02-13 17:55:35,890 INFO [Listener at localhost/35343] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 17:55:35,890 INFO [Listener at localhost/35343] compactions.PartitionedMobCompactor(367): [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302139cb0ed50cfd5464aabdd5837668c8eaf_del] 2023-02-13 17:55:35,890 DEBUG [Listener at localhost/35343] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:55:35,891 DEBUG [Listener at localhost/35343] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302139cb0ed50cfd5464aabdd5837668c8eaf_del to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302139cb0ed50cfd5464aabdd5837668c8eaf_del 2023-02-13 17:55:35,891 INFO [Listener at localhost/35343] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-02-13 17:55:35,891 INFO [Listener at localhost/35343] compactions.PartitionedMobCompactor(367): [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302136f56df509efe4d5aad14a56a15e1d50c_del] 2023-02-13 17:55:35,892 DEBUG [Listener at localhost/35343] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:55:35,893 DEBUG [Listener at localhost/35343] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302136f56df509efe4d5aad14a56a15e1d50c_del to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302136f56df509efe4d5aad14a56a15e1d50c_del 2023-02-13 17:55:35,893 INFO [Listener at localhost/35343] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-02-13 17:55:35,893 INFO [Listener at localhost/35343] compactions.PartitionedMobCompactor(367): [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302139d6240fea21f4b60961329ee609ed025_del] 2023-02-13 17:55:35,893 DEBUG [Listener at localhost/35343] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:55:35,894 DEBUG [Listener at localhost/35343] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302139d6240fea21f4b60961329ee609ed025_del to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302139d6240fea21f4b60961329ee609ed025_del 2023-02-13 17:55:35,894 INFO [Listener at localhost/35343] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-02-13 17:55:35,896 DEBUG [Listener at localhost/35343] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 17:55:35,898 DEBUG [Listener at localhost/35343] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 17:55:35,901 DEBUG [Listener at localhost/35343] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 17:55:35,902 DEBUG [Listener at localhost/35343] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 17:55:35,907 INFO [Listener at localhost/35343] client.HBaseAdmin$15(890): Started disable of testCompactionWithHFileLink 2023-02-13 17:55:35,907 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testCompactionWithHFileLink 2023-02-13 17:55:35,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure2.ProcedureExecutor(1029): Stored pid=88, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testCompactionWithHFileLink 2023-02-13 17:55:35,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-02-13 17:55:35,910 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676310935910"}]},"ts":"1676310935910"} 2023-02-13 17:55:35,911 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLING in hbase:meta 2023-02-13 17:55:35,912 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testCompactionWithHFileLink to state=DISABLING 2023-02-13 17:55:35,913 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3100400af58d7bf345cc01ad0d304911, UNASSIGN}, {pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=bb026d2891c65ad4947af9cdbd2aee81, UNASSIGN}, {pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=feb7d9eaf104f779ab1be2f45a76a113, UNASSIGN}] 2023-02-13 17:55:35,914 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=bb026d2891c65ad4947af9cdbd2aee81, UNASSIGN 2023-02-13 17:55:35,914 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=feb7d9eaf104f779ab1be2f45a76a113, UNASSIGN 2023-02-13 17:55:35,914 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3100400af58d7bf345cc01ad0d304911, UNASSIGN 2023-02-13 17:55:35,915 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=bb026d2891c65ad4947af9cdbd2aee81, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:35,915 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=3100400af58d7bf345cc01ad0d304911, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:35,915 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=feb7d9eaf104f779ab1be2f45a76a113, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:35,915 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676310935915"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676310935915"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676310935915"}]},"ts":"1676310935915"} 2023-02-13 17:55:35,915 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676310935915"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676310935915"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676310935915"}]},"ts":"1676310935915"} 2023-02-13 17:55:35,915 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676310935915"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676310935915"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676310935915"}]},"ts":"1676310935915"} 2023-02-13 17:55:35,916 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=92, ppid=90, state=RUNNABLE; CloseRegionProcedure bb026d2891c65ad4947af9cdbd2aee81, server=jenkins-hbase4.apache.org,38881,1676310818035}] 2023-02-13 17:55:35,917 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=89, state=RUNNABLE; CloseRegionProcedure 3100400af58d7bf345cc01ad0d304911, server=jenkins-hbase4.apache.org,38881,1676310818035}] 2023-02-13 17:55:35,917 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; CloseRegionProcedure feb7d9eaf104f779ab1be2f45a76a113, server=jenkins-hbase4.apache.org,38881,1676310818035}] 2023-02-13 17:55:36,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-02-13 17:55:36,068 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 3100400af58d7bf345cc01ad0d304911 2023-02-13 17:55:36,068 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3100400af58d7bf345cc01ad0d304911, disabling compactions & flushes 2023-02-13 17:55:36,068 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911. 2023-02-13 17:55:36,068 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911. 2023-02-13 17:55:36,068 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911. after waiting 0 ms 2023-02-13 17:55:36,068 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911. 2023-02-13 17:55:36,072 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-02-13 17:55:36,073 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911. 2023-02-13 17:55:36,073 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3100400af58d7bf345cc01ad0d304911: Waiting for close lock at 1676310936068Running coprocessor pre-close hooks at 1676310936068Disabling compacts and flushes for region at 1676310936068Disabling writes for close at 1676310936068Writing region close event to WAL at 1676310936069 (+1 ms)Running coprocessor post-close hooks at 1676310936072 (+3 ms)Closed at 1676310936073 (+1 ms) 2023-02-13 17:55:36,074 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 3100400af58d7bf345cc01ad0d304911 2023-02-13 17:55:36,074 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close bb026d2891c65ad4947af9cdbd2aee81 2023-02-13 17:55:36,074 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing bb026d2891c65ad4947af9cdbd2aee81, disabling compactions & flushes 2023-02-13 17:55:36,074 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81. 2023-02-13 17:55:36,074 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81. 2023-02-13 17:55:36,074 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81. after waiting 0 ms 2023-02-13 17:55:36,074 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81. 2023-02-13 17:55:36,074 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=3100400af58d7bf345cc01ad0d304911, regionState=CLOSED 2023-02-13 17:55:36,075 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676310936074"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676310936074"}]},"ts":"1676310936074"} 2023-02-13 17:55:36,077 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=89 2023-02-13 17:55:36,077 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=89, state=SUCCESS; CloseRegionProcedure 3100400af58d7bf345cc01ad0d304911, server=jenkins-hbase4.apache.org,38881,1676310818035 in 160 msec 2023-02-13 17:55:36,078 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-02-13 17:55:36,078 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=89, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3100400af58d7bf345cc01ad0d304911, UNASSIGN in 164 msec 2023-02-13 17:55:36,079 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81. 2023-02-13 17:55:36,079 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for bb026d2891c65ad4947af9cdbd2aee81: Waiting for close lock at 1676310936074Running coprocessor pre-close hooks at 1676310936074Disabling compacts and flushes for region at 1676310936074Disabling writes for close at 1676310936074Writing region close event to WAL at 1676310936075 (+1 ms)Running coprocessor post-close hooks at 1676310936078 (+3 ms)Closed at 1676310936079 (+1 ms) 2023-02-13 17:55:36,080 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed bb026d2891c65ad4947af9cdbd2aee81 2023-02-13 17:55:36,080 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close feb7d9eaf104f779ab1be2f45a76a113 2023-02-13 17:55:36,080 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing feb7d9eaf104f779ab1be2f45a76a113, disabling compactions & flushes 2023-02-13 17:55:36,080 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113. 2023-02-13 17:55:36,080 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113. 2023-02-13 17:55:36,080 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113. after waiting 0 ms 2023-02-13 17:55:36,080 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113. 2023-02-13 17:55:36,080 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=bb026d2891c65ad4947af9cdbd2aee81, regionState=CLOSED 2023-02-13 17:55:36,080 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676310936080"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676310936080"}]},"ts":"1676310936080"} 2023-02-13 17:55:36,083 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-02-13 17:55:36,083 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; CloseRegionProcedure bb026d2891c65ad4947af9cdbd2aee81, server=jenkins-hbase4.apache.org,38881,1676310818035 in 165 msec 2023-02-13 17:55:36,084 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=90, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=bb026d2891c65ad4947af9cdbd2aee81, UNASSIGN in 170 msec 2023-02-13 17:55:36,084 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-02-13 17:55:36,085 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113. 2023-02-13 17:55:36,085 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for feb7d9eaf104f779ab1be2f45a76a113: Waiting for close lock at 1676310936080Running coprocessor pre-close hooks at 1676310936080Disabling compacts and flushes for region at 1676310936080Disabling writes for close at 1676310936080Writing region close event to WAL at 1676310936081 (+1 ms)Running coprocessor post-close hooks at 1676310936084 (+3 ms)Closed at 1676310936085 (+1 ms) 2023-02-13 17:55:36,086 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed feb7d9eaf104f779ab1be2f45a76a113 2023-02-13 17:55:36,086 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=feb7d9eaf104f779ab1be2f45a76a113, regionState=CLOSED 2023-02-13 17:55:36,086 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676310936086"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676310936086"}]},"ts":"1676310936086"} 2023-02-13 17:55:36,088 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-02-13 17:55:36,088 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; CloseRegionProcedure feb7d9eaf104f779ab1be2f45a76a113, server=jenkins-hbase4.apache.org,38881,1676310818035 in 170 msec 2023-02-13 17:55:36,089 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=88 2023-02-13 17:55:36,089 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=feb7d9eaf104f779ab1be2f45a76a113, UNASSIGN in 175 msec 2023-02-13 17:55:36,089 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676310936089"}]},"ts":"1676310936089"} 2023-02-13 17:55:36,090 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLED in hbase:meta 2023-02-13 17:55:36,092 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testCompactionWithHFileLink to state=DISABLED 2023-02-13 17:55:36,093 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=88, state=SUCCESS; DisableTableProcedure table=testCompactionWithHFileLink in 185 msec 2023-02-13 17:55:36,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-02-13 17:55:36,212 INFO [Listener at localhost/35343] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testCompactionWithHFileLink, procId: 88 completed 2023-02-13 17:55:36,221 INFO [Listener at localhost/35343] client.HBaseAdmin(2586): Taking restore-failsafe snapshot: hbase-failsafe-snaptb-1676310923924-1676310936221 2023-02-13 17:55:36,222 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=hbase-failsafe-snaptb-1676310923924-1676310936221 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-13 17:55:36,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676310936222 (current time:1676310936222). 2023-02-13 17:55:36,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-13 17:55:36,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] zookeeper.ReadOnlyZKClient(139): Connect 0x506dc6b6 to 127.0.0.1:64825 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 17:55:36,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a3b1227, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 17:55:36,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 17:55:36,229 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52810, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 17:55:36,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x506dc6b6 to 127.0.0.1:64825 2023-02-13 17:55:36,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 17:55:36,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-13 17:55:36,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] snapshot.SnapshotManager(659): Table is disabled, running snapshot entirely on master for { ss=hbase-failsafe-snaptb-1676310923924-1676310936221 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-13 17:55:36,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-13 17:55:36,232 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-13 17:55:36,233 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1676311536233 2023-02-13 17:55:36,233 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running DISABLED table snapshot hbase-failsafe-snaptb-1676310923924-1676310936221 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-02-13 17:55:36,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] snapshot.SnapshotManager(664): Started snapshot: { ss=hbase-failsafe-snaptb-1676310923924-1676310936221 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-13 17:55:36,233 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase-failsafe-snaptb-1676310923924-1676310936221 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-02-13 17:55:36,233 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-13 17:55:36,333 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 17:55:36,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1676310923924-1676310936221 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-13 17:55:36,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1676310923924-1676310936221 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-13 17:55:36,334 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-13 17:55:36,535 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 17:55:36,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1676310923924-1676310936221 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-13 17:55:36,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1676310923924-1676310936221 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-13 17:55:36,536 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-13 17:55:36,639 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(97): Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1676310923924-1676310936221 table=testCompactionWithHFileLink type=DISABLED ttl=0 } 2023-02-13 17:55:36,640 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-02-13 17:55:36,640 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-02-13 17:55:36,640 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-02-13 17:55:36,640 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-02-13 17:55:36,641 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-02-13 17:55:36,641 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-02-13 17:55:36,640 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-02-13 17:55:36,640 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-02-13 17:55:36,643 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/6a1dff472f27430aa21635d58421cf2d_SeqId_29_, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/b471d45800af4cc7b96421696067177a] hfiles 2023-02-13 17:55:36,643 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/0b449e2574bb4535a04842953bc68169_SeqId_29_, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/baf3b9f07d2a4bac8e1d4543c1dc7cb4] hfiles 2023-02-13 17:55:36,643 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/6a1dff472f27430aa21635d58421cf2d_SeqId_29_ 2023-02-13 17:55:36,643 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/0b449e2574bb4535a04842953bc68169_SeqId_29_ 2023-02-13 17:55:36,643 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/b471d45800af4cc7b96421696067177a 2023-02-13 17:55:36,643 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/baf3b9f07d2a4bac8e1d4543c1dc7cb4 2023-02-13 17:55:36,643 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/54e7b1341a1f48fbafd4fc8b26200857, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/93dbe42aa0154b5c8a1159622499de50_SeqId_29_] hfiles 2023-02-13 17:55:36,643 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/54e7b1341a1f48fbafd4fc8b26200857 2023-02-13 17:55:36,644 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/93dbe42aa0154b5c8a1159622499de50_SeqId_29_ 2023-02-13 17:55:36,644 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023021312a83c6dea5d4129aaf513ab029e2873, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230213513794e59a7b42b4ae5c853362cc12af, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213dd6c5a22d69a49f3b6e8f27d82548c9a] hfiles 2023-02-13 17:55:36,644 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/3): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023021312a83c6dea5d4129aaf513ab029e2873 2023-02-13 17:55:36,644 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/3): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230213513794e59a7b42b4ae5c853362cc12af 2023-02-13 17:55:36,644 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (3/3): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213dd6c5a22d69a49f3b6e8f27d82548c9a 2023-02-13 17:55:36,644 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2/9917cda15f294cd1a9c62b69068cefca] hfiles 2023-02-13 17:55:36,644 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2/9917cda15f294cd1a9c62b69068cefca 2023-02-13 17:55:36,644 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2/df23d4e000124967989628c6bf886a7c] hfiles 2023-02-13 17:55:36,644 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2/df23d4e000124967989628c6bf886a7c 2023-02-13 17:55:36,644 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2/acf7ea1d1aef4fdd8202d04e8125e0e2] hfiles 2023-02-13 17:55:36,644 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2/acf7ea1d1aef4fdd8202d04e8125e0e2 2023-02-13 17:55:36,649 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213082c4da7bd0d4f7f9c8784d8b945ad1b, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023021320dc1eb6d4724a889be45ca3e3146c4f, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023021366dcce6f37a14b1085fd6560e8b41d41_del, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023021379b796fff0374d62ad0e395fdddd106b, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213fa36eef8827840ccb1f6f6e87f5dbeb0, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302133d32bac7abab49e7a3bd7573e6556bcc_del, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213705bed6eac8c49e1a5117e8b5b3398e2, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021374f9927dd8c94d258aa4b2f117e9d6d1, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213c3d4c88cedc34985b4a632a97934ed48, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213e61b7b133da1408695c38873c776d0f7, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302130e6f46dd9ee54f61b0b7f5bacda45b0f, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230213503e4be7eff3436cb2a36ee7d435aee7, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023021351acaee0ed8b40278ec2b3f56036883b, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023021382fd91fd47aa4c0fbaf7ed083a913a76, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302138c71a59c6e57428494d2b19585b18f40_del] hfiles 2023-02-13 17:55:36,650 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/15): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213082c4da7bd0d4f7f9c8784d8b945ad1b 2023-02-13 17:55:36,650 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/15): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023021320dc1eb6d4724a889be45ca3e3146c4f 2023-02-13 17:55:36,650 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (3/15): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023021366dcce6f37a14b1085fd6560e8b41d41_del 2023-02-13 17:55:36,650 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (4/15): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023021379b796fff0374d62ad0e395fdddd106b 2023-02-13 17:55:36,650 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (5/15): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213fa36eef8827840ccb1f6f6e87f5dbeb0 2023-02-13 17:55:36,650 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (6/15): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302133d32bac7abab49e7a3bd7573e6556bcc_del 2023-02-13 17:55:36,650 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (7/15): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213705bed6eac8c49e1a5117e8b5b3398e2 2023-02-13 17:55:36,650 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (8/15): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021374f9927dd8c94d258aa4b2f117e9d6d1 2023-02-13 17:55:36,650 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (9/15): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213c3d4c88cedc34985b4a632a97934ed48 2023-02-13 17:55:36,650 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (10/15): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213e61b7b133da1408695c38873c776d0f7 2023-02-13 17:55:36,650 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (11/15): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302130e6f46dd9ee54f61b0b7f5bacda45b0f 2023-02-13 17:55:36,650 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (12/15): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230213503e4be7eff3436cb2a36ee7d435aee7 2023-02-13 17:55:36,650 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (13/15): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023021351acaee0ed8b40278ec2b3f56036883b 2023-02-13 17:55:36,650 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (14/15): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023021382fd91fd47aa4c0fbaf7ed083a913a76 2023-02-13 17:55:36,650 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (15/15): hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302138c71a59c6e57428494d2b19585b18f40_del 2023-02-13 17:55:36,836 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 17:55:36,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1676310923924-1676310936221 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-13 17:55:36,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1676310923924-1676310936221 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-13 17:55:36,837 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-13 17:55:37,059 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(120): Marking snapshot{ ss=hbase-failsafe-snaptb-1676310923924-1676310936221 table=testCompactionWithHFileLink type=DISABLED ttl=0 } as finished. 2023-02-13 17:55:37,059 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase-failsafe-snaptb-1676310923924-1676310936221 2023-02-13 17:55:37,060 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1676310923924-1676310936221 2023-02-13 17:55:37,337 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 17:55:37,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1676310923924-1676310936221 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-13 17:55:37,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1676310923924-1676310936221 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-13 17:55:37,338 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-13 17:55:37,483 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1676310923924-1676310936221 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.hbase-snapshot/hbase-failsafe-snaptb-1676310923924-1676310936221 2023-02-13 17:55:38,298 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase-failsafe-snaptb-1676310923924-1676310936221 of table testCompactionWithHFileLink completed 2023-02-13 17:55:38,298 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1676310923924-1676310936221 2023-02-13 17:55:38,298 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1676310923924-1676310936221 2023-02-13 17:55:38,298 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running DISABLED table snapshot hbase-failsafe-snaptb-1676310923924-1676310936221 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1676310936233Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1676310923924-1676310936221 table=testCompactionWithHFileLink type=DISABLED ttl=0 } at 1676310936639 (+406 ms)Consolidate snapshot: hbase-failsafe-snaptb-1676310923924-1676310936221 at 1676310937059 (+420 ms)Loading Region manifests for hbase-failsafe-snaptb-1676310923924-1676310936221 at 1676310937060 (+1 ms)Writing data manifest for hbase-failsafe-snaptb-1676310923924-1676310936221 at 1676310937062 (+2 ms)Verifying snapshot: hbase-failsafe-snaptb-1676310923924-1676310936221 at 1676310937467 (+405 ms)Snapshot hbase-failsafe-snaptb-1676310923924-1676310936221 of table testCompactionWithHFileLink completed at 1676310938298 (+831 ms) 2023-02-13 17:55:38,299 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-13 17:55:38,300 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 2.0680 sec 2023-02-13 17:55:38,338 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 17:55:38,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1676310923924-1676310936221 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-13 17:55:38,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] snapshot.SnapshotManager(401): Snapshot '{ ss=hbase-failsafe-snaptb-1676310923924-1676310936221 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-13 17:55:38,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE:RESTORE_SNAPSHOT_PRE_OPERATION; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1676310923924" table: "testCompactionWithHFileLink" creation_time: 1676310923934 type: FLUSH version: 2 ttl: 0 ) 2023-02-13 17:55:38,373 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] snapshot.SnapshotManager(880): Restore snapshot=snaptb-1676310923924 as table=testCompactionWithHFileLink 2023-02-13 17:55:38,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-02-13 17:55:38,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-02-13 17:55:38,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-02-13 17:55:38,783 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-02-13 17:55:38,784 DEBUG [PEWorker-4] util.FSTableDescriptors(519): Deleted hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-02-13 17:55:38,784 INFO [PEWorker-4] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-02-13 17:55:38,784 INFO [PEWorker-4] procedure.RestoreSnapshotProcedure(374): Starting restore snapshot={ ss=snaptb-1676310923924 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-13 17:55:38,789 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "snaptb-1676310923924" table: "testCompactionWithHFileLink" creation_time: 1676310923934 type: FLUSH version: 2 ttl: 0 2023-02-13 17:55:38,789 DEBUG [PEWorker-4] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink 2023-02-13 17:55:38,793 DEBUG [PEWorker-4] snapshot.RestoreSnapshotHelper(797): found 3 regions for table=testCompactionWithHFileLink 2023-02-13 17:55:38,796 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023021312a83c6dea5d4129aaf513ab029e2873 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023021312a83c6dea5d4129aaf513ab029e2873 2023-02-13 17:55:38,798 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230213513794e59a7b42b4ae5c853362cc12af to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230213513794e59a7b42b4ae5c853362cc12af 2023-02-13 17:55:38,799 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213dd6c5a22d69a49f3b6e8f27d82548c9a to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213dd6c5a22d69a49f3b6e8f27d82548c9a 2023-02-13 17:55:38,799 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202302137eee19f62fc045d89ef731f1c9530586 of snapshot=snaptb-1676310923924 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-13 17:55:38,802 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202302139d7d463af0d4438b8241da37c0ba0354 of snapshot=snaptb-1676310923924 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-13 17:55:38,805 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230213dbd37ffc9d744d64b5e96b9ce742d460 of snapshot=snaptb-1676310923924 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-13 17:55:38,808 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230213fc2538b358534706a24fbf98242dfa71 of snapshot=snaptb-1676310923924 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-13 17:55:38,811 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202302137a1f3d451d5c4326baf651a772ecb753 of snapshot=snaptb-1676310923924 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-13 17:55:38,814 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202302137ce51ed0124b4c47be89d64a62b4981b of snapshot=snaptb-1676310923924 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-13 17:55:38,816 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230213a4cfd932ee82497b8b48fce3a3315d3a of snapshot=snaptb-1676310923924 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-13 17:55:38,819 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230213ee3933dd70424d2e834718749ce3b857 of snapshot=snaptb-1676310923924 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-13 17:55:38,822 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230213229fa23ca4364d5cbdb41b54922fba45 of snapshot=snaptb-1676310923924 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-13 17:55:38,825 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e2023021396722928928e4a41a06aa70fc6c582a1 of snapshot=snaptb-1676310923924 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-13 17:55:38,829 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230213a359d3362aaa4dcd968c7b94fd314224 of snapshot=snaptb-1676310923924 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-13 17:55:38,832 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230213c31399a9990c4a3c804dfe04b8369883 of snapshot=snaptb-1676310923924 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-13 17:55:38,837 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302138c71a59c6e57428494d2b19585b18f40_del to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302138c71a59c6e57428494d2b19585b18f40_del 2023-02-13 17:55:38,838 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023021366dcce6f37a14b1085fd6560e8b41d41_del to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023021366dcce6f37a14b1085fd6560e8b41d41_del 2023-02-13 17:55:38,839 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302133d32bac7abab49e7a3bd7573e6556bcc_del to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302133d32bac7abab49e7a3bd7573e6556bcc_del 2023-02-13 17:55:38,839 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(223): region to restore: 3100400af58d7bf345cc01ad0d304911 2023-02-13 17:55:38,840 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(223): region to restore: bb026d2891c65ad4947af9cdbd2aee81 2023-02-13 17:55:38,840 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(223): region to restore: feb7d9eaf104f779ab1be2f45a76a113 2023-02-13 17:55:38,843 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/b471d45800af4cc7b96421696067177a to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/b471d45800af4cc7b96421696067177a 2023-02-13 17:55:38,844 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/54e7b1341a1f48fbafd4fc8b26200857 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/54e7b1341a1f48fbafd4fc8b26200857 2023-02-13 17:55:38,845 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/0b449e2574bb4535a04842953bc68169_SeqId_29_ to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/0b449e2574bb4535a04842953bc68169_SeqId_29_ 2023-02-13 17:55:38,845 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/6a1dff472f27430aa21635d58421cf2d_SeqId_29_ to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/6a1dff472f27430aa21635d58421cf2d_SeqId_29_ 2023-02-13 17:55:38,845 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink e6560096ecd74736bebc5405b1d1b2a3 of snapshot=snaptb-1676310923924 to region=3100400af58d7bf345cc01ad0d304911 table=testCompactionWithHFileLink 2023-02-13 17:55:38,846 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/93dbe42aa0154b5c8a1159622499de50_SeqId_29_ to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/93dbe42aa0154b5c8a1159622499de50_SeqId_29_ 2023-02-13 17:55:38,846 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 3e7fe91c378b40949900da15f97302b5 of snapshot=snaptb-1676310923924 to region=bb026d2891c65ad4947af9cdbd2aee81 table=testCompactionWithHFileLink 2023-02-13 17:55:38,846 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/baf3b9f07d2a4bac8e1d4543c1dc7cb4 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/baf3b9f07d2a4bac8e1d4543c1dc7cb4 2023-02-13 17:55:38,846 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 42c1aafe213742ee932d1cd3d96850c5 of snapshot=snaptb-1676310923924 to region=feb7d9eaf104f779ab1be2f45a76a113 table=testCompactionWithHFileLink 2023-02-13 17:55:38,850 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 3a283a50ba284dc4a28a1af04674d6c4 of snapshot=snaptb-1676310923924 to region=bb026d2891c65ad4947af9cdbd2aee81 table=testCompactionWithHFileLink 2023-02-13 17:55:38,850 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 437f6f10fd1b4a209c4b0d4fa2e21fc8 of snapshot=snaptb-1676310923924 to region=feb7d9eaf104f779ab1be2f45a76a113 table=testCompactionWithHFileLink 2023-02-13 17:55:38,851 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 2dbd654356cf49ada19b27aa5ddccb8a of snapshot=snaptb-1676310923924 to region=3100400af58d7bf345cc01ad0d304911 table=testCompactionWithHFileLink 2023-02-13 17:55:38,854 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 097db5b1f29543ab9eb72d6e252351f3 of snapshot=snaptb-1676310923924 to region=feb7d9eaf104f779ab1be2f45a76a113 table=testCompactionWithHFileLink 2023-02-13 17:55:38,854 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 40923e1578564f6f8c56f4a4170ec489 of snapshot=snaptb-1676310923924 to region=bb026d2891c65ad4947af9cdbd2aee81 table=testCompactionWithHFileLink 2023-02-13 17:55:38,854 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 29b0fc5b96f14c4bacceeb69a12ebe2c of snapshot=snaptb-1676310923924 to region=3100400af58d7bf345cc01ad0d304911 table=testCompactionWithHFileLink 2023-02-13 17:55:38,857 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink e6249c54085e4a9b85698d7cdd4cd6f0 of snapshot=snaptb-1676310923924 to region=feb7d9eaf104f779ab1be2f45a76a113 table=testCompactionWithHFileLink 2023-02-13 17:55:38,857 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 75b940759fff45ea81b5b6e255f92641 of snapshot=snaptb-1676310923924 to region=bb026d2891c65ad4947af9cdbd2aee81 table=testCompactionWithHFileLink 2023-02-13 17:55:38,857 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink cf51030f8e2f4a669ebdb6d63c1b2f69 of snapshot=snaptb-1676310923924 to region=3100400af58d7bf345cc01ad0d304911 table=testCompactionWithHFileLink 2023-02-13 17:55:38,863 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2/df23d4e000124967989628c6bf886a7c to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2/df23d4e000124967989628c6bf886a7c 2023-02-13 17:55:38,863 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 4f54bee9443d4462a705bbaee479b92e of snapshot=snaptb-1676310923924 to region=feb7d9eaf104f779ab1be2f45a76a113 table=testCompactionWithHFileLink 2023-02-13 17:55:38,863 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2/9917cda15f294cd1a9c62b69068cefca to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2/9917cda15f294cd1a9c62b69068cefca 2023-02-13 17:55:38,863 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 32c4ec93ee254178b71387a374784c01 of snapshot=snaptb-1676310923924 to region=3100400af58d7bf345cc01ad0d304911 table=testCompactionWithHFileLink 2023-02-13 17:55:38,863 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2/acf7ea1d1aef4fdd8202d04e8125e0e2 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2/acf7ea1d1aef4fdd8202d04e8125e0e2 2023-02-13 17:55:38,863 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 608fde33f61b4c5985d5cd904d692f90 of snapshot=snaptb-1676310923924 to region=bb026d2891c65ad4947af9cdbd2aee81 table=testCompactionWithHFileLink 2023-02-13 17:55:38,869 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 8be2efbf57b743b085c80dd2eb0afaa9 of snapshot=snaptb-1676310923924 to region=3100400af58d7bf345cc01ad0d304911 table=testCompactionWithHFileLink 2023-02-13 17:55:38,869 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink e87955f045b64484847b386ef6899d94 of snapshot=snaptb-1676310923924 to region=feb7d9eaf104f779ab1be2f45a76a113 table=testCompactionWithHFileLink 2023-02-13 17:55:38,870 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 23f1089685c348a29b8ec869d0066855 of snapshot=snaptb-1676310923924 to region=bb026d2891c65ad4947af9cdbd2aee81 table=testCompactionWithHFileLink 2023-02-13 17:55:38,872 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 46a65080c58e40959b6f072bbd556cb4 of snapshot=snaptb-1676310923924 to region=3100400af58d7bf345cc01ad0d304911 table=testCompactionWithHFileLink 2023-02-13 17:55:38,873 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink e52fd15b18ae474e807cbc2aedac7040 of snapshot=snaptb-1676310923924 to region=feb7d9eaf104f779ab1be2f45a76a113 table=testCompactionWithHFileLink 2023-02-13 17:55:38,873 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 01097aa7d9cf4f0dbb75cfb2586a0995 of snapshot=snaptb-1676310923924 to region=bb026d2891c65ad4947af9cdbd2aee81 table=testCompactionWithHFileLink 2023-02-13 17:55:38,876 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink e06eec59679249679bbc717b4a660668 of snapshot=snaptb-1676310923924 to region=3100400af58d7bf345cc01ad0d304911 table=testCompactionWithHFileLink 2023-02-13 17:55:38,876 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 880a5ba4a8a74bb4b87ae5fa41be4939 of snapshot=snaptb-1676310923924 to region=feb7d9eaf104f779ab1be2f45a76a113 table=testCompactionWithHFileLink 2023-02-13 17:55:38,876 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 833e250a6055443d880f3a93997896df of snapshot=snaptb-1676310923924 to region=bb026d2891c65ad4947af9cdbd2aee81 table=testCompactionWithHFileLink 2023-02-13 17:55:38,879 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "snaptb-1676310923924" table: "testCompactionWithHFileLink" creation_time: 1676310923934 type: FLUSH version: 2 ttl: 0 2023-02-13 17:55:38,881 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676310938880"}]},"ts":"9223372036854775807"} 2023-02-13 17:55:38,881 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676310938880"}]},"ts":"9223372036854775807"} 2023-02-13 17:55:38,881 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676310938880"}]},"ts":"9223372036854775807"} 2023-02-13 17:55:38,882 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-02-13 17:55:38,882 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 3100400af58d7bf345cc01ad0d304911, NAME => 'testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => bb026d2891c65ad4947af9cdbd2aee81, NAME => 'testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => feb7d9eaf104f779ab1be2f45a76a113, NAME => 'testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113.', STARTKEY => '2', ENDKEY => ''}] 2023-02-13 17:55:38,882 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676310938881"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676310938881"}]},"ts":"1676310938881"} 2023-02-13 17:55:38,883 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676310938881"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676310938881"}]},"ts":"1676310938881"} 2023-02-13 17:55:38,883 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676310938881"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676310938881"}]},"ts":"1676310938881"} 2023-02-13 17:55:38,884 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-13 17:55:38,884 INFO [PEWorker-4] hbase.MetaTableAccessor(1810): Overwritten 3 regions to Meta 2023-02-13 17:55:38,884 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1811): Overwritten regions: [{ENCODED => 3100400af58d7bf345cc01ad0d304911, NAME => 'testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => bb026d2891c65ad4947af9cdbd2aee81, NAME => 'testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => feb7d9eaf104f779ab1be2f45a76a113, NAME => 'testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113.', STARTKEY => '2', ENDKEY => ''}] 2023-02-13 17:55:38,885 INFO [PEWorker-4] procedure.RestoreSnapshotProcedure(447): Restore snapshot={ ss=snaptb-1676310923924 table=testCompactionWithHFileLink type=FLUSH ttl=0 } on table=testCompactionWithHFileLink completed! 2023-02-13 17:55:38,886 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1676310923924" table: "testCompactionWithHFileLink" creation_time: 1676310923934 type: FLUSH version: 2 ttl: 0 ) in 520 msec 2023-02-13 17:55:38,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-02-13 17:55:38,979 INFO [Listener at localhost/35343] client.HBaseAdmin$TableFuture(3541): Operation: MODIFY, Table Name: default:testCompactionWithHFileLink, procId: 96 completed 2023-02-13 17:55:38,979 INFO [Listener at localhost/35343] client.HBaseAdmin(2618): Deleting restore-failsafe snapshot: hbase-failsafe-snaptb-1676310923924-1676310936221 2023-02-13 17:55:38,983 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "hbase-failsafe-snaptb-1676310923924-1676310936221" 2023-02-13 17:55:38,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] snapshot.SnapshotManager(333): Deleting snapshot: hbase-failsafe-snaptb-1676310923924-1676310936221 2023-02-13 17:55:38,987 INFO [Listener at localhost/35343] client.HBaseAdmin$14(830): Started enable of testCompactionWithHFileLink 2023-02-13 17:55:38,991 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.HMaster$10(2372): Client=jenkins//172.31.14.131 enable testCompactionWithHFileLink 2023-02-13 17:55:38,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE:ENABLE_TABLE_PREPARE; EnableTableProcedure table=testCompactionWithHFileLink 2023-02-13 17:55:38,999 INFO [PEWorker-3] procedure.EnableTableProcedure(296): Attempting to enable the table testCompactionWithHFileLink 2023-02-13 17:55:39,000 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676310938999"}]},"ts":"1676310938999"} 2023-02-13 17:55:39,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-13 17:55:39,001 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-02-13 17:55:39,003 DEBUG [PEWorker-3] procedure.EnableTableProcedure(107): No change in number of region replicas (configuredReplicaCount=1); assigning. 2023-02-13 17:55:39,003 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3100400af58d7bf345cc01ad0d304911, ASSIGN}, {pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=bb026d2891c65ad4947af9cdbd2aee81, ASSIGN}, {pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=feb7d9eaf104f779ab1be2f45a76a113, ASSIGN}] 2023-02-13 17:55:39,004 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=bb026d2891c65ad4947af9cdbd2aee81, ASSIGN 2023-02-13 17:55:39,004 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3100400af58d7bf345cc01ad0d304911, ASSIGN 2023-02-13 17:55:39,004 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=feb7d9eaf104f779ab1be2f45a76a113, ASSIGN 2023-02-13 17:55:39,004 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=bb026d2891c65ad4947af9cdbd2aee81, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-02-13 17:55:39,004 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3100400af58d7bf345cc01ad0d304911, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-02-13 17:55:39,005 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=feb7d9eaf104f779ab1be2f45a76a113, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-02-13 17:55:39,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-13 17:55:39,156 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=feb7d9eaf104f779ab1be2f45a76a113, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:39,156 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=bb026d2891c65ad4947af9cdbd2aee81, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:39,156 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=3100400af58d7bf345cc01ad0d304911, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:39,156 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676310939156"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676310939156"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676310939156"}]},"ts":"1676310939156"} 2023-02-13 17:55:39,156 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676310939156"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676310939156"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676310939156"}]},"ts":"1676310939156"} 2023-02-13 17:55:39,156 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676310939156"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676310939156"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676310939156"}]},"ts":"1676310939156"} 2023-02-13 17:55:39,158 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=101, ppid=99, state=RUNNABLE; OpenRegionProcedure bb026d2891c65ad4947af9cdbd2aee81, server=jenkins-hbase4.apache.org,38881,1676310818035}] 2023-02-13 17:55:39,158 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; OpenRegionProcedure feb7d9eaf104f779ab1be2f45a76a113, server=jenkins-hbase4.apache.org,38881,1676310818035}] 2023-02-13 17:55:39,158 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=98, state=RUNNABLE; OpenRegionProcedure 3100400af58d7bf345cc01ad0d304911, server=jenkins-hbase4.apache.org,38881,1676310818035}] 2023-02-13 17:55:39,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-13 17:55:39,311 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113. 2023-02-13 17:55:39,311 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => feb7d9eaf104f779ab1be2f45a76a113, NAME => 'testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113.', STARTKEY => '2', ENDKEY => ''} 2023-02-13 17:55:39,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink feb7d9eaf104f779ab1be2f45a76a113 2023-02-13 17:55:39,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 17:55:39,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for feb7d9eaf104f779ab1be2f45a76a113 2023-02-13 17:55:39,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for feb7d9eaf104f779ab1be2f45a76a113 2023-02-13 17:55:39,313 INFO [StoreOpener-feb7d9eaf104f779ab1be2f45a76a113-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region feb7d9eaf104f779ab1be2f45a76a113 2023-02-13 17:55:39,314 DEBUG [StoreOpener-feb7d9eaf104f779ab1be2f45a76a113-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1 2023-02-13 17:55:39,314 DEBUG [StoreOpener-feb7d9eaf104f779ab1be2f45a76a113-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1 2023-02-13 17:55:39,314 INFO [StoreOpener-feb7d9eaf104f779ab1be2f45a76a113-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region feb7d9eaf104f779ab1be2f45a76a113 columnFamilyName family1 2023-02-13 17:55:39,324 DEBUG [StoreOpener-feb7d9eaf104f779ab1be2f45a76a113-1] regionserver.HStore(539): loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/testCompactionWithHFileLink=feb7d9eaf104f779ab1be2f45a76a113-097db5b1f29543ab9eb72d6e252351f3 2023-02-13 17:55:39,329 DEBUG [StoreOpener-feb7d9eaf104f779ab1be2f45a76a113-1] regionserver.HStore(539): loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/testCompactionWithHFileLink=feb7d9eaf104f779ab1be2f45a76a113-42c1aafe213742ee932d1cd3d96850c5 2023-02-13 17:55:39,334 DEBUG [StoreOpener-feb7d9eaf104f779ab1be2f45a76a113-1] regionserver.HStore(539): loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/testCompactionWithHFileLink=feb7d9eaf104f779ab1be2f45a76a113-437f6f10fd1b4a209c4b0d4fa2e21fc8 2023-02-13 17:55:39,338 DEBUG [StoreOpener-feb7d9eaf104f779ab1be2f45a76a113-1] regionserver.HStore(539): loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/testCompactionWithHFileLink=feb7d9eaf104f779ab1be2f45a76a113-e6249c54085e4a9b85698d7cdd4cd6f0 2023-02-13 17:55:39,339 INFO [StoreOpener-feb7d9eaf104f779ab1be2f45a76a113-1] regionserver.HStore(310): Store=feb7d9eaf104f779ab1be2f45a76a113/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 17:55:39,339 INFO [StoreOpener-feb7d9eaf104f779ab1be2f45a76a113-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region feb7d9eaf104f779ab1be2f45a76a113 2023-02-13 17:55:39,340 DEBUG [StoreOpener-feb7d9eaf104f779ab1be2f45a76a113-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2 2023-02-13 17:55:39,340 DEBUG [StoreOpener-feb7d9eaf104f779ab1be2f45a76a113-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2 2023-02-13 17:55:39,340 INFO [StoreOpener-feb7d9eaf104f779ab1be2f45a76a113-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region feb7d9eaf104f779ab1be2f45a76a113 columnFamilyName family2 2023-02-13 17:55:39,345 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-02-13 17:55:39,347 DEBUG [StoreOpener-feb7d9eaf104f779ab1be2f45a76a113-1] regionserver.HStore(539): loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2/testCompactionWithHFileLink=feb7d9eaf104f779ab1be2f45a76a113-4f54bee9443d4462a705bbaee479b92e 2023-02-13 17:55:39,351 DEBUG [StoreOpener-feb7d9eaf104f779ab1be2f45a76a113-1] regionserver.HStore(539): loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2/testCompactionWithHFileLink=feb7d9eaf104f779ab1be2f45a76a113-880a5ba4a8a74bb4b87ae5fa41be4939 2023-02-13 17:55:39,355 DEBUG [StoreOpener-feb7d9eaf104f779ab1be2f45a76a113-1] regionserver.HStore(539): loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2/testCompactionWithHFileLink=feb7d9eaf104f779ab1be2f45a76a113-e52fd15b18ae474e807cbc2aedac7040 2023-02-13 17:55:39,360 DEBUG [StoreOpener-feb7d9eaf104f779ab1be2f45a76a113-1] regionserver.HStore(539): loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2/testCompactionWithHFileLink=feb7d9eaf104f779ab1be2f45a76a113-e87955f045b64484847b386ef6899d94 2023-02-13 17:55:39,360 INFO [StoreOpener-feb7d9eaf104f779ab1be2f45a76a113-1] regionserver.HStore(310): Store=feb7d9eaf104f779ab1be2f45a76a113/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 17:55:39,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113 2023-02-13 17:55:39,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113 2023-02-13 17:55:39,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 17:55:39,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for feb7d9eaf104f779ab1be2f45a76a113 2023-02-13 17:55:39,365 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened feb7d9eaf104f779ab1be2f45a76a113; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70042320, jitterRate=0.04371190071105957}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 17:55:39,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for feb7d9eaf104f779ab1be2f45a76a113: Running coprocessor pre-open hook at 1676310939312Writing region info on filesystem at 1676310939312Initializing all the Stores at 1676310939313 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676310939313Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676310939313Cleaning up temporary data from old regions at 1676310939363 (+50 ms)Cleaning up detritus from prior splits at 1676310939363Running coprocessor post-open hooks at 1676310939366 (+3 ms)Region opened successfully at 1676310939366 2023-02-13 17:55:39,366 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113., pid=102, masterSystemTime=1676310939309 2023-02-13 17:55:39,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 17:55:39,367 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-13 17:55:39,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 17:55:39,367 DEBUG [RS:0;jenkins-hbase4:38881-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-13 17:55:39,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113. 2023-02-13 17:55:39,368 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113. 2023-02-13 17:55:39,368 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81. 2023-02-13 17:55:39,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => bb026d2891c65ad4947af9cdbd2aee81, NAME => 'testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81.', STARTKEY => '1', ENDKEY => '2'} 2023-02-13 17:55:39,369 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=feb7d9eaf104f779ab1be2f45a76a113, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:39,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink bb026d2891c65ad4947af9cdbd2aee81 2023-02-13 17:55:39,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 17:55:39,369 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676310939369"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676310939369"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676310939369"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676310939369"}]},"ts":"1676310939369"} 2023-02-13 17:55:39,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for bb026d2891c65ad4947af9cdbd2aee81 2023-02-13 17:55:39,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for bb026d2891c65ad4947af9cdbd2aee81 2023-02-13 17:55:39,369 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-13 17:55:39,370 DEBUG [RS:0;jenkins-hbase4:38881-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-13 17:55:39,370 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HStore(1912): feb7d9eaf104f779ab1be2f45a76a113/family1 is initiating minor compaction (all files) 2023-02-13 17:55:39,370 DEBUG [RS:0;jenkins-hbase4:38881-longCompactions-0] regionserver.HStore(1912): feb7d9eaf104f779ab1be2f45a76a113/family2 is initiating minor compaction (all files) 2023-02-13 17:55:39,370 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of feb7d9eaf104f779ab1be2f45a76a113/family1 in testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113. 2023-02-13 17:55:39,370 INFO [RS:0;jenkins-hbase4:38881-longCompactions-0] regionserver.HRegion(2258): Starting compaction of feb7d9eaf104f779ab1be2f45a76a113/family2 in testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113. 2023-02-13 17:55:39,370 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/testCompactionWithHFileLink=feb7d9eaf104f779ab1be2f45a76a113-42c1aafe213742ee932d1cd3d96850c5, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/testCompactionWithHFileLink=feb7d9eaf104f779ab1be2f45a76a113-437f6f10fd1b4a209c4b0d4fa2e21fc8, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/testCompactionWithHFileLink=feb7d9eaf104f779ab1be2f45a76a113-097db5b1f29543ab9eb72d6e252351f3, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/testCompactionWithHFileLink=feb7d9eaf104f779ab1be2f45a76a113-e6249c54085e4a9b85698d7cdd4cd6f0] into tmpdir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/.tmp, totalSize=21.6 K 2023-02-13 17:55:39,370 INFO [RS:0;jenkins-hbase4:38881-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2/testCompactionWithHFileLink=feb7d9eaf104f779ab1be2f45a76a113-4f54bee9443d4462a705bbaee479b92e, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2/testCompactionWithHFileLink=feb7d9eaf104f779ab1be2f45a76a113-e87955f045b64484847b386ef6899d94, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2/testCompactionWithHFileLink=feb7d9eaf104f779ab1be2f45a76a113-e52fd15b18ae474e807cbc2aedac7040, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2/testCompactionWithHFileLink=feb7d9eaf104f779ab1be2f45a76a113-880a5ba4a8a74bb4b87ae5fa41be4939] into tmpdir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/.tmp, totalSize=20.4 K 2023-02-13 17:55:39,370 INFO [StoreOpener-bb026d2891c65ad4947af9cdbd2aee81-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region bb026d2891c65ad4947af9cdbd2aee81 2023-02-13 17:55:39,371 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=feb7d9eaf104f779ab1be2f45a76a113-42c1aafe213742ee932d1cd3d96850c5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676310916769 2023-02-13 17:55:39,371 DEBUG [RS:0;jenkins-hbase4:38881-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=feb7d9eaf104f779ab1be2f45a76a113-4f54bee9443d4462a705bbaee479b92e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676310916769 2023-02-13 17:55:39,372 DEBUG [StoreOpener-bb026d2891c65ad4947af9cdbd2aee81-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1 2023-02-13 17:55:39,372 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=feb7d9eaf104f779ab1be2f45a76a113-437f6f10fd1b4a209c4b0d4fa2e21fc8, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676310918551 2023-02-13 17:55:39,372 DEBUG [StoreOpener-bb026d2891c65ad4947af9cdbd2aee81-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1 2023-02-13 17:55:39,372 DEBUG [RS:0;jenkins-hbase4:38881-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=feb7d9eaf104f779ab1be2f45a76a113-e87955f045b64484847b386ef6899d94, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676310918551 2023-02-13 17:55:39,373 INFO [StoreOpener-bb026d2891c65ad4947af9cdbd2aee81-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bb026d2891c65ad4947af9cdbd2aee81 columnFamilyName family1 2023-02-13 17:55:39,373 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-02-13 17:55:39,373 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; OpenRegionProcedure feb7d9eaf104f779ab1be2f45a76a113, server=jenkins-hbase4.apache.org,38881,1676310818035 in 213 msec 2023-02-13 17:55:39,374 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=feb7d9eaf104f779ab1be2f45a76a113, ASSIGN in 370 msec 2023-02-13 17:55:39,377 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=feb7d9eaf104f779ab1be2f45a76a113-097db5b1f29543ab9eb72d6e252351f3, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676310920347 2023-02-13 17:55:39,378 DEBUG [RS:0;jenkins-hbase4:38881-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=feb7d9eaf104f779ab1be2f45a76a113-e52fd15b18ae474e807cbc2aedac7040, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676310920347 2023-02-13 17:55:39,378 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=feb7d9eaf104f779ab1be2f45a76a113-e6249c54085e4a9b85698d7cdd4cd6f0, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676310922143 2023-02-13 17:55:39,378 DEBUG [RS:0;jenkins-hbase4:38881-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=feb7d9eaf104f779ab1be2f45a76a113-880a5ba4a8a74bb4b87ae5fa41be4939, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676310922143 2023-02-13 17:55:39,391 DEBUG [StoreOpener-bb026d2891c65ad4947af9cdbd2aee81-1] regionserver.HStore(539): loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/testCompactionWithHFileLink=bb026d2891c65ad4947af9cdbd2aee81-3a283a50ba284dc4a28a1af04674d6c4 2023-02-13 17:55:39,399 DEBUG [StoreOpener-bb026d2891c65ad4947af9cdbd2aee81-1] regionserver.HStore(539): loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/testCompactionWithHFileLink=bb026d2891c65ad4947af9cdbd2aee81-3e7fe91c378b40949900da15f97302b5 2023-02-13 17:55:39,416 DEBUG [StoreOpener-bb026d2891c65ad4947af9cdbd2aee81-1] regionserver.HStore(539): loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/testCompactionWithHFileLink=bb026d2891c65ad4947af9cdbd2aee81-40923e1578564f6f8c56f4a4170ec489 2023-02-13 17:55:39,421 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] throttle.PressureAwareThroughputController(145): feb7d9eaf104f779ab1be2f45a76a113#family1#compaction#114 average throughput is 0.26 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 50.00 MB/second 2023-02-13 17:55:39,428 INFO [RS:0;jenkins-hbase4:38881-longCompactions-0] throttle.PressureAwareThroughputController(145): feb7d9eaf104f779ab1be2f45a76a113#family2#compaction#115 average throughput is 0.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 17:55:39,430 DEBUG [StoreOpener-bb026d2891c65ad4947af9cdbd2aee81-1] regionserver.HStore(539): loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/testCompactionWithHFileLink=bb026d2891c65ad4947af9cdbd2aee81-75b940759fff45ea81b5b6e255f92641 2023-02-13 17:55:39,432 INFO [StoreOpener-bb026d2891c65ad4947af9cdbd2aee81-1] regionserver.HStore(310): Store=bb026d2891c65ad4947af9cdbd2aee81/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 17:55:39,432 INFO [StoreOpener-bb026d2891c65ad4947af9cdbd2aee81-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region bb026d2891c65ad4947af9cdbd2aee81 2023-02-13 17:55:39,433 DEBUG [StoreOpener-bb026d2891c65ad4947af9cdbd2aee81-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2 2023-02-13 17:55:39,433 DEBUG [StoreOpener-bb026d2891c65ad4947af9cdbd2aee81-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2 2023-02-13 17:55:39,433 INFO [StoreOpener-bb026d2891c65ad4947af9cdbd2aee81-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bb026d2891c65ad4947af9cdbd2aee81 columnFamilyName family2 2023-02-13 17:55:39,447 DEBUG [StoreOpener-bb026d2891c65ad4947af9cdbd2aee81-1] regionserver.HStore(539): loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2/testCompactionWithHFileLink=bb026d2891c65ad4947af9cdbd2aee81-01097aa7d9cf4f0dbb75cfb2586a0995 2023-02-13 17:55:39,452 DEBUG [StoreOpener-bb026d2891c65ad4947af9cdbd2aee81-1] regionserver.HStore(539): loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2/testCompactionWithHFileLink=bb026d2891c65ad4947af9cdbd2aee81-23f1089685c348a29b8ec869d0066855 2023-02-13 17:55:39,456 DEBUG [StoreOpener-bb026d2891c65ad4947af9cdbd2aee81-1] regionserver.HStore(539): loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2/testCompactionWithHFileLink=bb026d2891c65ad4947af9cdbd2aee81-608fde33f61b4c5985d5cd904d692f90 2023-02-13 17:55:39,460 DEBUG [StoreOpener-bb026d2891c65ad4947af9cdbd2aee81-1] regionserver.HStore(539): loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2/testCompactionWithHFileLink=bb026d2891c65ad4947af9cdbd2aee81-833e250a6055443d880f3a93997896df 2023-02-13 17:55:39,460 INFO [StoreOpener-bb026d2891c65ad4947af9cdbd2aee81-1] regionserver.HStore(310): Store=bb026d2891c65ad4947af9cdbd2aee81/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 17:55:39,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81 2023-02-13 17:55:39,462 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81 2023-02-13 17:55:39,464 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 17:55:39,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for bb026d2891c65ad4947af9cdbd2aee81 2023-02-13 17:55:39,465 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened bb026d2891c65ad4947af9cdbd2aee81; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72423631, jitterRate=0.07919619977474213}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 17:55:39,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for bb026d2891c65ad4947af9cdbd2aee81: Running coprocessor pre-open hook at 1676310939369Writing region info on filesystem at 1676310939369Initializing all the Stores at 1676310939370 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676310939370Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676310939371 (+1 ms)Cleaning up temporary data from old regions at 1676310939463 (+92 ms)Cleaning up detritus from prior splits at 1676310939463Running coprocessor post-open hooks at 1676310939465 (+2 ms)Region opened successfully at 1676310939465 2023-02-13 17:55:39,466 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81., pid=101, masterSystemTime=1676310939309 2023-02-13 17:55:39,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-02-13 17:55:39,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-02-13 17:55:39,467 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81. 2023-02-13 17:55:39,467 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81. 2023-02-13 17:55:39,467 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911. 2023-02-13 17:55:39,467 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3100400af58d7bf345cc01ad0d304911, NAME => 'testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911.', STARTKEY => '', ENDKEY => '1'} 2023-02-13 17:55:39,467 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=bb026d2891c65ad4947af9cdbd2aee81, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:39,468 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 3100400af58d7bf345cc01ad0d304911 2023-02-13 17:55:39,468 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 17:55:39,468 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676310939467"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676310939467"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676310939467"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676310939467"}]},"ts":"1676310939467"} 2023-02-13 17:55:39,468 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3100400af58d7bf345cc01ad0d304911 2023-02-13 17:55:39,468 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3100400af58d7bf345cc01ad0d304911 2023-02-13 17:55:39,469 INFO [StoreOpener-3100400af58d7bf345cc01ad0d304911-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 3100400af58d7bf345cc01ad0d304911 2023-02-13 17:55:39,470 DEBUG [StoreOpener-3100400af58d7bf345cc01ad0d304911-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1 2023-02-13 17:55:39,470 DEBUG [StoreOpener-3100400af58d7bf345cc01ad0d304911-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1 2023-02-13 17:55:39,470 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-02-13 17:55:39,470 INFO [StoreOpener-3100400af58d7bf345cc01ad0d304911-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3100400af58d7bf345cc01ad0d304911 columnFamilyName family1 2023-02-13 17:55:39,470 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; OpenRegionProcedure bb026d2891c65ad4947af9cdbd2aee81, server=jenkins-hbase4.apache.org,38881,1676310818035 in 312 msec 2023-02-13 17:55:39,471 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=99, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=bb026d2891c65ad4947af9cdbd2aee81, ASSIGN in 467 msec 2023-02-13 17:55:39,478 DEBUG [StoreOpener-3100400af58d7bf345cc01ad0d304911-1] regionserver.HStore(539): loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/testCompactionWithHFileLink=3100400af58d7bf345cc01ad0d304911-29b0fc5b96f14c4bacceeb69a12ebe2c 2023-02-13 17:55:39,484 DEBUG [StoreOpener-3100400af58d7bf345cc01ad0d304911-1] regionserver.HStore(539): loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/testCompactionWithHFileLink=3100400af58d7bf345cc01ad0d304911-2dbd654356cf49ada19b27aa5ddccb8a 2023-02-13 17:55:39,489 DEBUG [StoreOpener-3100400af58d7bf345cc01ad0d304911-1] regionserver.HStore(539): loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/testCompactionWithHFileLink=3100400af58d7bf345cc01ad0d304911-cf51030f8e2f4a669ebdb6d63c1b2f69 2023-02-13 17:55:39,495 DEBUG [StoreOpener-3100400af58d7bf345cc01ad0d304911-1] regionserver.HStore(539): loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/testCompactionWithHFileLink=3100400af58d7bf345cc01ad0d304911-e6560096ecd74736bebc5405b1d1b2a3 2023-02-13 17:55:39,496 INFO [StoreOpener-3100400af58d7bf345cc01ad0d304911-1] regionserver.HStore(310): Store=3100400af58d7bf345cc01ad0d304911/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 17:55:39,496 INFO [StoreOpener-3100400af58d7bf345cc01ad0d304911-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 3100400af58d7bf345cc01ad0d304911 2023-02-13 17:55:39,497 DEBUG [StoreOpener-3100400af58d7bf345cc01ad0d304911-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2 2023-02-13 17:55:39,497 DEBUG [StoreOpener-3100400af58d7bf345cc01ad0d304911-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2 2023-02-13 17:55:39,497 INFO [StoreOpener-3100400af58d7bf345cc01ad0d304911-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3100400af58d7bf345cc01ad0d304911 columnFamilyName family2 2023-02-13 17:55:39,505 DEBUG [StoreOpener-3100400af58d7bf345cc01ad0d304911-1] regionserver.HStore(539): loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2/testCompactionWithHFileLink=3100400af58d7bf345cc01ad0d304911-32c4ec93ee254178b71387a374784c01 2023-02-13 17:55:39,512 DEBUG [StoreOpener-3100400af58d7bf345cc01ad0d304911-1] regionserver.HStore(539): loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2/testCompactionWithHFileLink=3100400af58d7bf345cc01ad0d304911-46a65080c58e40959b6f072bbd556cb4 2023-02-13 17:55:39,518 DEBUG [StoreOpener-3100400af58d7bf345cc01ad0d304911-1] regionserver.HStore(539): loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2/testCompactionWithHFileLink=3100400af58d7bf345cc01ad0d304911-8be2efbf57b743b085c80dd2eb0afaa9 2023-02-13 17:55:39,525 DEBUG [StoreOpener-3100400af58d7bf345cc01ad0d304911-1] regionserver.HStore(539): loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2/testCompactionWithHFileLink=3100400af58d7bf345cc01ad0d304911-e06eec59679249679bbc717b4a660668 2023-02-13 17:55:39,525 INFO [StoreOpener-3100400af58d7bf345cc01ad0d304911-1] regionserver.HStore(310): Store=3100400af58d7bf345cc01ad0d304911/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 17:55:39,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911 2023-02-13 17:55:39,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911 2023-02-13 17:55:39,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 17:55:39,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3100400af58d7bf345cc01ad0d304911 2023-02-13 17:55:39,529 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3100400af58d7bf345cc01ad0d304911; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60957162, jitterRate=-0.09166750311851501}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 17:55:39,530 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3100400af58d7bf345cc01ad0d304911: Running coprocessor pre-open hook at 1676310939468Writing region info on filesystem at 1676310939468Initializing all the Stores at 1676310939468Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676310939468Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676310939469 (+1 ms)Cleaning up temporary data from old regions at 1676310939527 (+58 ms)Cleaning up detritus from prior splits at 1676310939527Running coprocessor post-open hooks at 1676310939529 (+2 ms)Region opened successfully at 1676310939529 2023-02-13 17:55:39,530 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911., pid=103, masterSystemTime=1676310939309 2023-02-13 17:55:39,530 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-02-13 17:55:39,530 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-02-13 17:55:39,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911. 2023-02-13 17:55:39,532 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911. 2023-02-13 17:55:39,532 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=3100400af58d7bf345cc01ad0d304911, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:39,532 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676310939532"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676310939532"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676310939532"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676310939532"}]},"ts":"1676310939532"} 2023-02-13 17:55:39,535 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=98 2023-02-13 17:55:39,535 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=98, state=SUCCESS; OpenRegionProcedure 3100400af58d7bf345cc01ad0d304911, server=jenkins-hbase4.apache.org,38881,1676310818035 in 376 msec 2023-02-13 17:55:39,536 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=98, resume processing ppid=97 2023-02-13 17:55:39,536 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=98, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3100400af58d7bf345cc01ad0d304911, ASSIGN in 532 msec 2023-02-13 17:55:39,537 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676310939537"}]},"ts":"1676310939537"} 2023-02-13 17:55:39,538 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-02-13 17:55:39,539 INFO [PEWorker-5] procedure.EnableTableProcedure(310): Table 'testCompactionWithHFileLink' was successfully enabled. 2023-02-13 17:55:39,541 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; EnableTableProcedure table=testCompactionWithHFileLink in 547 msec 2023-02-13 17:55:39,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-13 17:55:39,603 INFO [Listener at localhost/35343] client.HBaseAdmin$TableFuture(3541): Operation: ENABLE, Table Name: default:testCompactionWithHFileLink, procId: 97 completed 2023-02-13 17:55:39,614 DEBUG [Listener at localhost/35343] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 17:55:39,623 DEBUG [Listener at localhost/35343] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 17:55:39,631 DEBUG [Listener at localhost/35343] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 17:55:39,632 DEBUG [Listener at localhost/35343] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 17:55:39,639 INFO [Listener at localhost/35343] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-13 17:55:39,653 INFO [Listener at localhost/35343] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-02-13 17:55:39,653 INFO [Listener at localhost/35343] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testCompactionWithHFileLink' column='family1' 2023-02-13 17:55:39,654 DEBUG [Listener at localhost/35343] zookeeper.ReadOnlyZKClient(139): Connect 0x0e13a0e8 to 127.0.0.1:64825 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 17:55:39,658 DEBUG [Listener at localhost/35343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@65d35e4b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 17:55:39,658 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230213 for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 17:55:39,658 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230213 for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 17:55:39,658 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230213 for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 17:55:40,146 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302134a9251f7535c4ebdabef0e7bb95ddc77 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302134a9251f7535c4ebdabef0e7bb95ddc77 2023-02-13 17:55:40,147 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230213 table='testCompactionWithHFileLink' column='family1' 2023-02-13 17:55:40,159 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 17:55:40,162 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52818, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 17:55:40,168 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 17:55:40,174 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43278, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 17:55:40,187 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230213/family1/62df6797635f49a595513b452b331330 first=Optional[1\x00\x00\x00\x00] last=Optional[1\x00\x00\x00\x07] 2023-02-13 17:55:40,187 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81., hostname=jenkins-hbase4.apache.org,38881,1676310818035, seqNum=32 for row 1 with hfile group [{family1,hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230213/family1/62df6797635f49a595513b452b331330}] 2023-02-13 17:55:40,192 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(763): Validating hfile at hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230213/family1/62df6797635f49a595513b452b331330 for inclusion in bb026d2891c65ad4947af9cdbd2aee81/family1 2023-02-13 17:55:40,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x00 last=1\x00\x00\x00\x07 2023-02-13 17:55:40,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(777): Region bounds: first=1 last=2 2023-02-13 17:55:40,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HRegion(2445): Flush status journal for bb026d2891c65ad4947af9cdbd2aee81: 2023-02-13 17:55:40,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230213/family1/62df6797635f49a595513b452b331330 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testCompactionWithHFileLink__vis3kdmks252a2bjm3kug8lm323d1tr3j9n4boarc1ogp681jnj8cndi11i4p629/family1/62df6797635f49a595513b452b331330 2023-02-13 17:55:40,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testCompactionWithHFileLink__vis3kdmks252a2bjm3kug8lm323d1tr3j9n4boarc1ogp681jnj8cndi11i4p629/family1/62df6797635f49a595513b452b331330 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/f9cb30c1a63e4cd29f18aae226d53ada_SeqId_34_ 2023-02-13 17:55:40,197 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(849): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testCompactionWithHFileLink__vis3kdmks252a2bjm3kug8lm323d1tr3j9n4boarc1ogp681jnj8cndi11i4p629/family1/62df6797635f49a595513b452b331330 into bb026d2891c65ad4947af9cdbd2aee81/family1 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/f9cb30c1a63e4cd29f18aae226d53ada_SeqId_34_ - updating store file list. 2023-02-13 17:55:40,200 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(882): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/f9cb30c1a63e4cd29f18aae226d53ada_SeqId_34_ into bb026d2891c65ad4947af9cdbd2aee81/family1 2023-02-13 17:55:40,200 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(855): Successfully loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testCompactionWithHFileLink__vis3kdmks252a2bjm3kug8lm323d1tr3j9n4boarc1ogp681jnj8cndi11i4p629/family1/62df6797635f49a595513b452b331330 into bb026d2891c65ad4947af9cdbd2aee81/family1 (new location: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/f9cb30c1a63e4cd29f18aae226d53ada_SeqId_34_) 2023-02-13 17:55:40,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testCompactionWithHFileLink__vis3kdmks252a2bjm3kug8lm323d1tr3j9n4boarc1ogp681jnj8cndi11i4p629/family1/62df6797635f49a595513b452b331330 2023-02-13 17:55:40,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 17:55:40,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-02-13 17:55:40,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(1912): bb026d2891c65ad4947af9cdbd2aee81/family1 is initiating minor compaction (all files) 2023-02-13 17:55:40,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4efccc59; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-02-13 17:55:40,205 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230213 table='testCompactionWithHFileLink' column='family1' 2023-02-13 17:55:40,205 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:55:40,207 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202302137eee19f62fc045d89ef731f1c9530586 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202302137eee19f62fc045d89ef731f1c9530586 2023-02-13 17:55:40,208 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202302139d7d463af0d4438b8241da37c0ba0354 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202302139d7d463af0d4438b8241da37c0ba0354 2023-02-13 17:55:40,208 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230213dbd37ffc9d744d64b5e96b9ce742d460 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230213dbd37ffc9d744d64b5e96b9ce742d460 2023-02-13 17:55:40,209 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230213fc2538b358534706a24fbf98242dfa71 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230213fc2538b358534706a24fbf98242dfa71 2023-02-13 17:55:40,209 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-13 17:55:40,209 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230213' 2023-02-13 17:55:40,209 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230213 for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 17:55:40,251 DEBUG [RS:0;jenkins-hbase4:38881-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/.tmp/family2/b62b5894d6064848aa01ead9a50fc95a as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2/b62b5894d6064848aa01ead9a50fc95a 2023-02-13 17:55:40,255 INFO [RS:0;jenkins-hbase4:38881-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in feb7d9eaf104f779ab1be2f45a76a113/family2 of feb7d9eaf104f779ab1be2f45a76a113 into b62b5894d6064848aa01ead9a50fc95a(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 17:55:40,255 DEBUG [RS:0;jenkins-hbase4:38881-longCompactions-0] regionserver.HRegion(2288): Compaction status journal for feb7d9eaf104f779ab1be2f45a76a113: 2023-02-13 17:55:40,255 INFO [RS:0;jenkins-hbase4:38881-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113., storeName=feb7d9eaf104f779ab1be2f45a76a113/family2, priority=12, startTime=1676310939367; duration=0sec 2023-02-13 17:55:40,255 DEBUG [RS:0;jenkins-hbase4:38881-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-02-13 17:55:40,255 INFO [RS:0;jenkins-hbase4:38881-longCompactions-0] regionserver.HRegion(2258): Starting compaction of bb026d2891c65ad4947af9cdbd2aee81/family1 in testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81. 2023-02-13 17:55:40,255 INFO [RS:0;jenkins-hbase4:38881-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/testCompactionWithHFileLink=bb026d2891c65ad4947af9cdbd2aee81-3e7fe91c378b40949900da15f97302b5, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/testCompactionWithHFileLink=bb026d2891c65ad4947af9cdbd2aee81-3a283a50ba284dc4a28a1af04674d6c4, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/testCompactionWithHFileLink=bb026d2891c65ad4947af9cdbd2aee81-40923e1578564f6f8c56f4a4170ec489, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/testCompactionWithHFileLink=bb026d2891c65ad4947af9cdbd2aee81-75b940759fff45ea81b5b6e255f92641, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/f9cb30c1a63e4cd29f18aae226d53ada_SeqId_34_] into tmpdir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/.tmp, totalSize=28.9 K 2023-02-13 17:55:40,256 DEBUG [RS:0;jenkins-hbase4:38881-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=bb026d2891c65ad4947af9cdbd2aee81-3e7fe91c378b40949900da15f97302b5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676310916769 2023-02-13 17:55:40,256 DEBUG [RS:0;jenkins-hbase4:38881-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=bb026d2891c65ad4947af9cdbd2aee81-3a283a50ba284dc4a28a1af04674d6c4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676310918550 2023-02-13 17:55:40,257 DEBUG [RS:0;jenkins-hbase4:38881-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=bb026d2891c65ad4947af9cdbd2aee81-40923e1578564f6f8c56f4a4170ec489, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676310920347 2023-02-13 17:55:40,257 DEBUG [RS:0;jenkins-hbase4:38881-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=bb026d2891c65ad4947af9cdbd2aee81-75b940759fff45ea81b5b6e255f92641, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676310922143 2023-02-13 17:55:40,257 DEBUG [RS:0;jenkins-hbase4:38881-longCompactions-0] compactions.Compactor(207): Compacting f9cb30c1a63e4cd29f18aae226d53ada_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1676310916769 2023-02-13 17:55:40,270 INFO [RS:0;jenkins-hbase4:38881-longCompactions-0] throttle.PressureAwareThroughputController(145): bb026d2891c65ad4947af9cdbd2aee81#family1#compaction#116 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 17:55:40,346 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2/testCompactionWithHFileLink=feb7d9eaf104f779ab1be2f45a76a113-4f54bee9443d4462a705bbaee479b92e, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2/testCompactionWithHFileLink=feb7d9eaf104f779ab1be2f45a76a113-e87955f045b64484847b386ef6899d94, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2/testCompactionWithHFileLink=feb7d9eaf104f779ab1be2f45a76a113-e52fd15b18ae474e807cbc2aedac7040, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2/testCompactionWithHFileLink=feb7d9eaf104f779ab1be2f45a76a113-880a5ba4a8a74bb4b87ae5fa41be4939] to archive 2023-02-13 17:55:40,347 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:55:40,348 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2/testCompactionWithHFileLink=feb7d9eaf104f779ab1be2f45a76a113-4f54bee9443d4462a705bbaee479b92e to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2/testCompactionWithHFileLink=feb7d9eaf104f779ab1be2f45a76a113-4f54bee9443d4462a705bbaee479b92e 2023-02-13 17:55:40,350 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2/testCompactionWithHFileLink=feb7d9eaf104f779ab1be2f45a76a113-e87955f045b64484847b386ef6899d94 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2/testCompactionWithHFileLink=feb7d9eaf104f779ab1be2f45a76a113-e87955f045b64484847b386ef6899d94 2023-02-13 17:55:40,351 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2/testCompactionWithHFileLink=feb7d9eaf104f779ab1be2f45a76a113-e52fd15b18ae474e807cbc2aedac7040 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2/testCompactionWithHFileLink=feb7d9eaf104f779ab1be2f45a76a113-e52fd15b18ae474e807cbc2aedac7040 2023-02-13 17:55:40,352 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2/testCompactionWithHFileLink=feb7d9eaf104f779ab1be2f45a76a113-880a5ba4a8a74bb4b87ae5fa41be4939 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family2/testCompactionWithHFileLink=feb7d9eaf104f779ab1be2f45a76a113-880a5ba4a8a74bb4b87ae5fa41be4939 2023-02-13 17:55:40,544 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302134ddbdc72efd14bd3b168fe5cca315364 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302134ddbdc72efd14bd3b168fe5cca315364 2023-02-13 17:55:40,544 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302138b3cdbb6e6a74af3bc81c4d3f3f86570 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302138b3cdbb6e6a74af3bc81c4d3f3f86570 2023-02-13 17:55:40,545 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230213 table='testCompactionWithHFileLink' column='family1' 2023-02-13 17:55:40,545 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230213 table='testCompactionWithHFileLink' column='family1' 2023-02-13 17:55:40,569 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230213/family1/f78ac7e3db664f21a68deb6da1a33837 first=Optional[0\x00\x00\x00\x00] last=Optional[0\x00\x00\x00\x07] 2023-02-13 17:55:40,569 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230213/family1/4c6b39d2d4cc4d5684f58f00b551dbe4 first=Optional[2\x00\x00\x00\x00] last=Optional[2\x00\x00\x00\x07] 2023-02-13 17:55:40,570 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911., hostname=jenkins-hbase4.apache.org,38881,1676310818035, seqNum=32 for row with hfile group [{family1,hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230213/family1/f78ac7e3db664f21a68deb6da1a33837}] 2023-02-13 17:55:40,570 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113., hostname=jenkins-hbase4.apache.org,38881,1676310818035, seqNum=32 for row 2 with hfile group [{family1,hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230213/family1/4c6b39d2d4cc4d5684f58f00b551dbe4}] 2023-02-13 17:55:40,572 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(763): Validating hfile at hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230213/family1/f78ac7e3db664f21a68deb6da1a33837 for inclusion in 3100400af58d7bf345cc01ad0d304911/family1 2023-02-13 17:55:40,572 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(763): Validating hfile at hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230213/family1/4c6b39d2d4cc4d5684f58f00b551dbe4 for inclusion in feb7d9eaf104f779ab1be2f45a76a113/family1 2023-02-13 17:55:40,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x00 last=0\x00\x00\x00\x07 2023-02-13 17:55:40,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(777): Region bounds: first= last=1 2023-02-13 17:55:40,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x00 last=2\x00\x00\x00\x07 2023-02-13 17:55:40,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-13 17:55:40,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegion(2445): Flush status journal for 3100400af58d7bf345cc01ad0d304911: 2023-02-13 17:55:40,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HRegion(2445): Flush status journal for feb7d9eaf104f779ab1be2f45a76a113: 2023-02-13 17:55:40,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230213/family1/f78ac7e3db664f21a68deb6da1a33837 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testCompactionWithHFileLink__fktritjm470d5lce4f5umfk94s2jav8li18jh384hgshc330e9urat6biu1cp8o1/family1/f78ac7e3db664f21a68deb6da1a33837 2023-02-13 17:55:40,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230213/family1/4c6b39d2d4cc4d5684f58f00b551dbe4 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testCompactionWithHFileLink__vmtra4lfk6l0id0ko7mblt8vg62rsvolvot18s359ud8japnjjlagqdf7879h777/family1/4c6b39d2d4cc4d5684f58f00b551dbe4 2023-02-13 17:55:40,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testCompactionWithHFileLink__fktritjm470d5lce4f5umfk94s2jav8li18jh384hgshc330e9urat6biu1cp8o1/family1/f78ac7e3db664f21a68deb6da1a33837 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/88a9c510d90f4ffdbb584a8c8e45a6f6_SeqId_34_ 2023-02-13 17:55:40,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testCompactionWithHFileLink__vmtra4lfk6l0id0ko7mblt8vg62rsvolvot18s359ud8japnjjlagqdf7879h777/family1/4c6b39d2d4cc4d5684f58f00b551dbe4 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/9e0b0dd84861441d9aa93048611b2187_SeqId_35_ 2023-02-13 17:55:40,577 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(849): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testCompactionWithHFileLink__fktritjm470d5lce4f5umfk94s2jav8li18jh384hgshc330e9urat6biu1cp8o1/family1/f78ac7e3db664f21a68deb6da1a33837 into 3100400af58d7bf345cc01ad0d304911/family1 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/88a9c510d90f4ffdbb584a8c8e45a6f6_SeqId_34_ - updating store file list. 2023-02-13 17:55:40,577 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(849): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testCompactionWithHFileLink__vmtra4lfk6l0id0ko7mblt8vg62rsvolvot18s359ud8japnjjlagqdf7879h777/family1/4c6b39d2d4cc4d5684f58f00b551dbe4 into feb7d9eaf104f779ab1be2f45a76a113/family1 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/9e0b0dd84861441d9aa93048611b2187_SeqId_35_ - updating store file list. 2023-02-13 17:55:40,580 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(882): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/9e0b0dd84861441d9aa93048611b2187_SeqId_35_ into feb7d9eaf104f779ab1be2f45a76a113/family1 2023-02-13 17:55:40,580 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(882): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/88a9c510d90f4ffdbb584a8c8e45a6f6_SeqId_34_ into 3100400af58d7bf345cc01ad0d304911/family1 2023-02-13 17:55:40,580 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(855): Successfully loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testCompactionWithHFileLink__vmtra4lfk6l0id0ko7mblt8vg62rsvolvot18s359ud8japnjjlagqdf7879h777/family1/4c6b39d2d4cc4d5684f58f00b551dbe4 into feb7d9eaf104f779ab1be2f45a76a113/family1 (new location: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/9e0b0dd84861441d9aa93048611b2187_SeqId_35_) 2023-02-13 17:55:40,580 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(855): Successfully loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testCompactionWithHFileLink__fktritjm470d5lce4f5umfk94s2jav8li18jh384hgshc330e9urat6biu1cp8o1/family1/f78ac7e3db664f21a68deb6da1a33837 into 3100400af58d7bf345cc01ad0d304911/family1 (new location: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/88a9c510d90f4ffdbb584a8c8e45a6f6_SeqId_34_) 2023-02-13 17:55:40,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testCompactionWithHFileLink__vmtra4lfk6l0id0ko7mblt8vg62rsvolvot18s359ud8japnjjlagqdf7879h777/family1/4c6b39d2d4cc4d5684f58f00b551dbe4 2023-02-13 17:55:40,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testCompactionWithHFileLink__fktritjm470d5lce4f5umfk94s2jav8li18jh384hgshc330e9urat6biu1cp8o1/family1/f78ac7e3db664f21a68deb6da1a33837 2023-02-13 17:55:40,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 17:55:40,582 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230213 table='testCompactionWithHFileLink' column='family1' 2023-02-13 17:55:40,583 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:55:40,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-02-13 17:55:40,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(1912): 3100400af58d7bf345cc01ad0d304911/family1 is initiating minor compaction (all files) 2023-02-13 17:55:40,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1545241e; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-02-13 17:55:40,584 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202302137a1f3d451d5c4326baf651a772ecb753 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202302137a1f3d451d5c4326baf651a772ecb753 2023-02-13 17:55:40,585 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230213 table='testCompactionWithHFileLink' column='family1' 2023-02-13 17:55:40,585 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202302137ce51ed0124b4c47be89d64a62b4981b to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202302137ce51ed0124b4c47be89d64a62b4981b 2023-02-13 17:55:40,586 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:55:40,586 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230213a4cfd932ee82497b8b48fce3a3315d3a to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230213a4cfd932ee82497b8b48fce3a3315d3a 2023-02-13 17:55:40,587 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230213229fa23ca4364d5cbdb41b54922fba45 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230213229fa23ca4364d5cbdb41b54922fba45 2023-02-13 17:55:40,587 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230213ee3933dd70424d2e834718749ce3b857 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230213ee3933dd70424d2e834718749ce3b857 2023-02-13 17:55:40,588 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-13 17:55:40,588 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230213' 2023-02-13 17:55:40,588 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230213 for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 17:55:40,588 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023021396722928928e4a41a06aa70fc6c582a1 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023021396722928928e4a41a06aa70fc6c582a1 2023-02-13 17:55:40,589 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230213a359d3362aaa4dcd968c7b94fd314224 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230213a359d3362aaa4dcd968c7b94fd314224 2023-02-13 17:55:40,590 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230213c31399a9990c4a3c804dfe04b8369883 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230213c31399a9990c4a3c804dfe04b8369883 2023-02-13 17:55:40,590 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-13 17:55:40,590 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230213' 2023-02-13 17:55:40,590 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230213 for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 17:55:40,590 INFO [Listener at localhost/35343] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-02-13 17:55:40,593 DEBUG [Listener at localhost/35343] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 17:55:40,595 DEBUG [Listener at localhost/35343] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 17:55:40,599 DEBUG [Listener at localhost/35343] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 17:55:40,600 DEBUG [Listener at localhost/35343] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 17:55:40,605 DEBUG [Listener at localhost/35343] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 17:55:40,606 DEBUG [Listener at localhost/35343] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 17:55:40,622 INFO [Listener at localhost/35343] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=285 (was 245) - Thread LEAK? -, OpenFileDescriptor=761 (was 615) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=156 (was 146) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=919 (was 972) 2023-02-13 17:55:40,633 INFO [Listener at localhost/35343] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompaction Thread=285, OpenFileDescriptor=761, MaxFileDescriptor=60000, SystemLoadAverage=156, ProcessCount=168, AvailableMemoryMB=918 2023-02-13 17:55:40,638 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.HMaster$15(2997): Client=jenkins//172.31.14.131 creating {NAME => 'ns'} 2023-02-13 17:55:40,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=ns 2023-02-13 17:55:40,643 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/.tmp/family1/22f359368cbd4e4d92bd531d536e9a5f as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/22f359368cbd4e4d92bd531d536e9a5f 2023-02-13 17:55:40,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=104 2023-02-13 17:55:40,646 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 17:55:40,648 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; CreateNamespaceProcedure, namespace=ns in 8 msec 2023-02-13 17:55:40,652 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in feb7d9eaf104f779ab1be2f45a76a113/family1 of feb7d9eaf104f779ab1be2f45a76a113 into 22f359368cbd4e4d92bd531d536e9a5f(size=7.6 K), total size for store is 14.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 17:55:40,652 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for feb7d9eaf104f779ab1be2f45a76a113: 2023-02-13 17:55:40,652 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113., storeName=feb7d9eaf104f779ab1be2f45a76a113/family1, priority=12, startTime=1676310939366; duration=1sec 2023-02-13 17:55:40,652 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-02-13 17:55:40,652 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 3100400af58d7bf345cc01ad0d304911/family1 in testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911. 2023-02-13 17:55:40,652 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/testCompactionWithHFileLink=3100400af58d7bf345cc01ad0d304911-e6560096ecd74736bebc5405b1d1b2a3, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/testCompactionWithHFileLink=3100400af58d7bf345cc01ad0d304911-2dbd654356cf49ada19b27aa5ddccb8a, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/testCompactionWithHFileLink=3100400af58d7bf345cc01ad0d304911-29b0fc5b96f14c4bacceeb69a12ebe2c, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/testCompactionWithHFileLink=3100400af58d7bf345cc01ad0d304911-cf51030f8e2f4a669ebdb6d63c1b2f69, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/88a9c510d90f4ffdbb584a8c8e45a6f6_SeqId_34_] into tmpdir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/.tmp, totalSize=28.9 K 2023-02-13 17:55:40,653 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=3100400af58d7bf345cc01ad0d304911-e6560096ecd74736bebc5405b1d1b2a3, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676310916767 2023-02-13 17:55:40,653 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=3100400af58d7bf345cc01ad0d304911-2dbd654356cf49ada19b27aa5ddccb8a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676310918550 2023-02-13 17:55:40,654 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=3100400af58d7bf345cc01ad0d304911-29b0fc5b96f14c4bacceeb69a12ebe2c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676310920346 2023-02-13 17:55:40,654 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=3100400af58d7bf345cc01ad0d304911-cf51030f8e2f4a669ebdb6d63c1b2f69, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676310922142 2023-02-13 17:55:40,654 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting 88a9c510d90f4ffdbb584a8c8e45a6f6_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1676310916767 2023-02-13 17:55:40,668 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] throttle.PressureAwareThroughputController(145): 3100400af58d7bf345cc01ad0d304911#family1#compaction#117 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 17:55:40,684 DEBUG [RS:0;jenkins-hbase4:38881-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/.tmp/family1/209d473284d94ed2aef2f1a68bfdb8cc as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/209d473284d94ed2aef2f1a68bfdb8cc 2023-02-13 17:55:40,688 INFO [RS:0;jenkins-hbase4:38881-longCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in bb026d2891c65ad4947af9cdbd2aee81/family1 of bb026d2891c65ad4947af9cdbd2aee81 into 209d473284d94ed2aef2f1a68bfdb8cc(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 17:55:40,688 DEBUG [RS:0;jenkins-hbase4:38881-longCompactions-0] regionserver.HRegion(2288): Compaction status journal for bb026d2891c65ad4947af9cdbd2aee81: 2023-02-13 17:55:40,688 INFO [RS:0;jenkins-hbase4:38881-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1676310940203; duration=0sec 2023-02-13 17:55:40,688 DEBUG [RS:0;jenkins-hbase4:38881-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-02-13 17:55:40,689 DEBUG [RS:0;jenkins-hbase4:38881-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-13 17:55:40,690 DEBUG [RS:0;jenkins-hbase4:38881-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-13 17:55:40,690 DEBUG [RS:0;jenkins-hbase4:38881-longCompactions-0] regionserver.HStore(1912): 3100400af58d7bf345cc01ad0d304911/family2 is initiating minor compaction (all files) 2023-02-13 17:55:40,690 INFO [RS:0;jenkins-hbase4:38881-longCompactions-0] regionserver.HRegion(2258): Starting compaction of 3100400af58d7bf345cc01ad0d304911/family2 in testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911. 2023-02-13 17:55:40,691 INFO [RS:0;jenkins-hbase4:38881-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2/testCompactionWithHFileLink=3100400af58d7bf345cc01ad0d304911-32c4ec93ee254178b71387a374784c01, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2/testCompactionWithHFileLink=3100400af58d7bf345cc01ad0d304911-8be2efbf57b743b085c80dd2eb0afaa9, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2/testCompactionWithHFileLink=3100400af58d7bf345cc01ad0d304911-46a65080c58e40959b6f072bbd556cb4, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2/testCompactionWithHFileLink=3100400af58d7bf345cc01ad0d304911-e06eec59679249679bbc717b4a660668] into tmpdir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/.tmp, totalSize=20.4 K 2023-02-13 17:55:40,691 DEBUG [RS:0;jenkins-hbase4:38881-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=3100400af58d7bf345cc01ad0d304911-32c4ec93ee254178b71387a374784c01, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676310916767 2023-02-13 17:55:40,692 DEBUG [RS:0;jenkins-hbase4:38881-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=3100400af58d7bf345cc01ad0d304911-8be2efbf57b743b085c80dd2eb0afaa9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676310918550 2023-02-13 17:55:40,692 DEBUG [RS:0;jenkins-hbase4:38881-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=3100400af58d7bf345cc01ad0d304911-46a65080c58e40959b6f072bbd556cb4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676310920346 2023-02-13 17:55:40,692 DEBUG [RS:0;jenkins-hbase4:38881-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=3100400af58d7bf345cc01ad0d304911-e06eec59679249679bbc717b4a660668, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676310922142 2023-02-13 17:55:40,703 INFO [RS:0;jenkins-hbase4:38881-longCompactions-0] throttle.PressureAwareThroughputController(145): 3100400af58d7bf345cc01ad0d304911#family2#compaction#118 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 17:55:40,737 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/testCompactionWithHFileLink=feb7d9eaf104f779ab1be2f45a76a113-42c1aafe213742ee932d1cd3d96850c5, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/testCompactionWithHFileLink=feb7d9eaf104f779ab1be2f45a76a113-437f6f10fd1b4a209c4b0d4fa2e21fc8, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/testCompactionWithHFileLink=feb7d9eaf104f779ab1be2f45a76a113-097db5b1f29543ab9eb72d6e252351f3, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/testCompactionWithHFileLink=feb7d9eaf104f779ab1be2f45a76a113-e6249c54085e4a9b85698d7cdd4cd6f0] to archive 2023-02-13 17:55:40,738 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:55:40,739 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/testCompactionWithHFileLink=feb7d9eaf104f779ab1be2f45a76a113-42c1aafe213742ee932d1cd3d96850c5 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/testCompactionWithHFileLink=feb7d9eaf104f779ab1be2f45a76a113-42c1aafe213742ee932d1cd3d96850c5 2023-02-13 17:55:40,740 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/testCompactionWithHFileLink=feb7d9eaf104f779ab1be2f45a76a113-437f6f10fd1b4a209c4b0d4fa2e21fc8 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/testCompactionWithHFileLink=feb7d9eaf104f779ab1be2f45a76a113-437f6f10fd1b4a209c4b0d4fa2e21fc8 2023-02-13 17:55:40,741 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/testCompactionWithHFileLink=feb7d9eaf104f779ab1be2f45a76a113-097db5b1f29543ab9eb72d6e252351f3 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/testCompactionWithHFileLink=feb7d9eaf104f779ab1be2f45a76a113-097db5b1f29543ab9eb72d6e252351f3 2023-02-13 17:55:40,742 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/testCompactionWithHFileLink=feb7d9eaf104f779ab1be2f45a76a113-e6249c54085e4a9b85698d7cdd4cd6f0 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/family1/testCompactionWithHFileLink=feb7d9eaf104f779ab1be2f45a76a113-e6249c54085e4a9b85698d7cdd4cd6f0 2023-02-13 17:55:40,743 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/testCompactionWithHFileLink=bb026d2891c65ad4947af9cdbd2aee81-3e7fe91c378b40949900da15f97302b5, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/testCompactionWithHFileLink=bb026d2891c65ad4947af9cdbd2aee81-3a283a50ba284dc4a28a1af04674d6c4, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/testCompactionWithHFileLink=bb026d2891c65ad4947af9cdbd2aee81-40923e1578564f6f8c56f4a4170ec489, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/testCompactionWithHFileLink=bb026d2891c65ad4947af9cdbd2aee81-75b940759fff45ea81b5b6e255f92641, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/f9cb30c1a63e4cd29f18aae226d53ada_SeqId_34_] to archive 2023-02-13 17:55:40,744 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:55:40,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=104 2023-02-13 17:55:40,745 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/testCompactionWithHFileLink=bb026d2891c65ad4947af9cdbd2aee81-3e7fe91c378b40949900da15f97302b5 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/testCompactionWithHFileLink=bb026d2891c65ad4947af9cdbd2aee81-3e7fe91c378b40949900da15f97302b5 2023-02-13 17:55:40,745 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-13 17:55:40,746 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/testCompactionWithHFileLink=bb026d2891c65ad4947af9cdbd2aee81-3a283a50ba284dc4a28a1af04674d6c4 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/testCompactionWithHFileLink=bb026d2891c65ad4947af9cdbd2aee81-3a283a50ba284dc4a28a1af04674d6c4 2023-02-13 17:55:40,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=ns:testMinorCompaction 2023-02-13 17:55:40,748 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/testCompactionWithHFileLink=bb026d2891c65ad4947af9cdbd2aee81-40923e1578564f6f8c56f4a4170ec489 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/testCompactionWithHFileLink=bb026d2891c65ad4947af9cdbd2aee81-40923e1578564f6f8c56f4a4170ec489 2023-02-13 17:55:40,748 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 17:55:40,748 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "ns" qualifier: "testMinorCompaction" procId is: 105 2023-02-13 17:55:40,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-13 17:55:40,749 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 17:55:40,749 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/testCompactionWithHFileLink=bb026d2891c65ad4947af9cdbd2aee81-75b940759fff45ea81b5b6e255f92641 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/testCompactionWithHFileLink=bb026d2891c65ad4947af9cdbd2aee81-75b940759fff45ea81b5b6e255f92641 2023-02-13 17:55:40,750 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/f9cb30c1a63e4cd29f18aae226d53ada_SeqId_34_ to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family1/f9cb30c1a63e4cd29f18aae226d53ada_SeqId_34_ 2023-02-13 17:55:40,751 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6 2023-02-13 17:55:40,751 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927 2023-02-13 17:55:40,751 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689 2023-02-13 17:55:40,751 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6 empty. 2023-02-13 17:55:40,751 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927 empty. 2023-02-13 17:55:40,751 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689 empty. 2023-02-13 17:55:40,751 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6 2023-02-13 17:55:40,751 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927 2023-02-13 17:55:40,751 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689 2023-02-13 17:55:40,751 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived ns:testMinorCompaction regions 2023-02-13 17:55:40,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-13 17:55:41,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-13 17:55:41,158 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/ns/testMinorCompaction/.tabledesc/.tableinfo.0000000001 2023-02-13 17:55:41,159 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(7671): creating {ENCODED => 7ec577192744923b1bb4fd6145642689, NAME => 'ns:testMinorCompaction,2,1676310940745.7ec577192744923b1bb4fd6145642689.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp 2023-02-13 17:55:41,159 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(7671): creating {ENCODED => 226b4a6bd1e102bd425b4fe5fa7b9927, NAME => 'ns:testMinorCompaction,1,1676310940745.226b4a6bd1e102bd425b4fe5fa7b9927.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp 2023-02-13 17:55:41,159 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(7671): creating {ENCODED => 0e77f96cde768bcde1fba587339782c6, NAME => 'ns:testMinorCompaction,,1676310940745.0e77f96cde768bcde1fba587339782c6.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp 2023-02-13 17:55:41,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-13 17:55:41,565 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,2,1676310940745.7ec577192744923b1bb4fd6145642689.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 17:55:41,565 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,,1676310940745.0e77f96cde768bcde1fba587339782c6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 17:55:41,565 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1603): Closing 7ec577192744923b1bb4fd6145642689, disabling compactions & flushes 2023-02-13 17:55:41,565 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1603): Closing 0e77f96cde768bcde1fba587339782c6, disabling compactions & flushes 2023-02-13 17:55:41,565 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,2,1676310940745.7ec577192744923b1bb4fd6145642689. 2023-02-13 17:55:41,565 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,1,1676310940745.226b4a6bd1e102bd425b4fe5fa7b9927.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 17:55:41,565 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,,1676310940745.0e77f96cde768bcde1fba587339782c6. 2023-02-13 17:55:41,565 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1603): Closing 226b4a6bd1e102bd425b4fe5fa7b9927, disabling compactions & flushes 2023-02-13 17:55:41,565 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,2,1676310940745.7ec577192744923b1bb4fd6145642689. 2023-02-13 17:55:41,565 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,1,1676310940745.226b4a6bd1e102bd425b4fe5fa7b9927. 2023-02-13 17:55:41,565 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,1,1676310940745.226b4a6bd1e102bd425b4fe5fa7b9927. 2023-02-13 17:55:41,565 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,,1676310940745.0e77f96cde768bcde1fba587339782c6. 2023-02-13 17:55:41,565 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,1,1676310940745.226b4a6bd1e102bd425b4fe5fa7b9927. after waiting 0 ms 2023-02-13 17:55:41,565 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,1,1676310940745.226b4a6bd1e102bd425b4fe5fa7b9927. 2023-02-13 17:55:41,565 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,2,1676310940745.7ec577192744923b1bb4fd6145642689. after waiting 0 ms 2023-02-13 17:55:41,565 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1837): Closed ns:testMinorCompaction,1,1676310940745.226b4a6bd1e102bd425b4fe5fa7b9927. 2023-02-13 17:55:41,565 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,2,1676310940745.7ec577192744923b1bb4fd6145642689. 2023-02-13 17:55:41,565 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,,1676310940745.0e77f96cde768bcde1fba587339782c6. after waiting 0 ms 2023-02-13 17:55:41,565 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1837): Closed ns:testMinorCompaction,2,1676310940745.7ec577192744923b1bb4fd6145642689. 2023-02-13 17:55:41,565 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1557): Region close journal for 226b4a6bd1e102bd425b4fe5fa7b9927: Waiting for close lock at 1676310941565Disabling compacts and flushes for region at 1676310941565Disabling writes for close at 1676310941565Writing region close event to WAL at 1676310941565Closed at 1676310941565 2023-02-13 17:55:41,565 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1557): Region close journal for 7ec577192744923b1bb4fd6145642689: Waiting for close lock at 1676310941565Disabling compacts and flushes for region at 1676310941565Disabling writes for close at 1676310941565Writing region close event to WAL at 1676310941565Closed at 1676310941565 2023-02-13 17:55:41,565 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,,1676310940745.0e77f96cde768bcde1fba587339782c6. 2023-02-13 17:55:41,566 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1837): Closed ns:testMinorCompaction,,1676310940745.0e77f96cde768bcde1fba587339782c6. 2023-02-13 17:55:41,566 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1557): Region close journal for 0e77f96cde768bcde1fba587339782c6: Waiting for close lock at 1676310941565Disabling compacts and flushes for region at 1676310941565Disabling writes for close at 1676310941565Writing region close event to WAL at 1676310941566 (+1 ms)Closed at 1676310941566 2023-02-13 17:55:41,568 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 17:55:41,568 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,1,1676310940745.226b4a6bd1e102bd425b4fe5fa7b9927.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1676310941568"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676310941568"}]},"ts":"1676310941568"} 2023-02-13 17:55:41,569 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,2,1676310940745.7ec577192744923b1bb4fd6145642689.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1676310941568"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676310941568"}]},"ts":"1676310941568"} 2023-02-13 17:55:41,569 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,,1676310940745.0e77f96cde768bcde1fba587339782c6.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1676310941568"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676310941568"}]},"ts":"1676310941568"} 2023-02-13 17:55:41,570 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-13 17:55:41,571 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 17:55:41,571 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676310941571"}]},"ts":"1676310941571"} 2023-02-13 17:55:41,572 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLING in hbase:meta 2023-02-13 17:55:41,575 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=0e77f96cde768bcde1fba587339782c6, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=226b4a6bd1e102bd425b4fe5fa7b9927, ASSIGN}, {pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=7ec577192744923b1bb4fd6145642689, ASSIGN}] 2023-02-13 17:55:41,576 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=7ec577192744923b1bb4fd6145642689, ASSIGN 2023-02-13 17:55:41,576 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=0e77f96cde768bcde1fba587339782c6, ASSIGN 2023-02-13 17:55:41,576 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=226b4a6bd1e102bd425b4fe5fa7b9927, ASSIGN 2023-02-13 17:55:41,577 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=7ec577192744923b1bb4fd6145642689, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38881,1676310818035; forceNewPlan=false, retain=false 2023-02-13 17:55:41,577 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=0e77f96cde768bcde1fba587339782c6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38881,1676310818035; forceNewPlan=false, retain=false 2023-02-13 17:55:41,577 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=226b4a6bd1e102bd425b4fe5fa7b9927, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38881,1676310818035; forceNewPlan=false, retain=false 2023-02-13 17:55:41,606 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 17:55:41,729 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=7ec577192744923b1bb4fd6145642689, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:41,729 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=226b4a6bd1e102bd425b4fe5fa7b9927, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:41,729 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=0e77f96cde768bcde1fba587339782c6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:41,730 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,2,1676310940745.7ec577192744923b1bb4fd6145642689.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1676310941729"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676310941729"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676310941729"}]},"ts":"1676310941729"} 2023-02-13 17:55:41,730 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,,1676310940745.0e77f96cde768bcde1fba587339782c6.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1676310941729"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676310941729"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676310941729"}]},"ts":"1676310941729"} 2023-02-13 17:55:41,730 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,1,1676310940745.226b4a6bd1e102bd425b4fe5fa7b9927.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1676310941729"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676310941729"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676310941729"}]},"ts":"1676310941729"} 2023-02-13 17:55:41,731 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=108, state=RUNNABLE; OpenRegionProcedure 7ec577192744923b1bb4fd6145642689, server=jenkins-hbase4.apache.org,38881,1676310818035}] 2023-02-13 17:55:41,731 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=110, ppid=106, state=RUNNABLE; OpenRegionProcedure 0e77f96cde768bcde1fba587339782c6, server=jenkins-hbase4.apache.org,38881,1676310818035}] 2023-02-13 17:55:41,732 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=111, ppid=107, state=RUNNABLE; OpenRegionProcedure 226b4a6bd1e102bd425b4fe5fa7b9927, server=jenkins-hbase4.apache.org,38881,1676310818035}] 2023-02-13 17:55:41,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-13 17:55:41,885 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,,1676310940745.0e77f96cde768bcde1fba587339782c6. 2023-02-13 17:55:41,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 0e77f96cde768bcde1fba587339782c6, NAME => 'ns:testMinorCompaction,,1676310940745.0e77f96cde768bcde1fba587339782c6.', STARTKEY => '', ENDKEY => '1'} 2023-02-13 17:55:41,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 0e77f96cde768bcde1fba587339782c6 2023-02-13 17:55:41,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,,1676310940745.0e77f96cde768bcde1fba587339782c6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 17:55:41,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 0e77f96cde768bcde1fba587339782c6 2023-02-13 17:55:41,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 0e77f96cde768bcde1fba587339782c6 2023-02-13 17:55:41,886 INFO [StoreOpener-0e77f96cde768bcde1fba587339782c6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 0e77f96cde768bcde1fba587339782c6 2023-02-13 17:55:41,887 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/.tmp/family1/be21b0a696e74a09a6b4cfd1068aecd7 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/be21b0a696e74a09a6b4cfd1068aecd7 2023-02-13 17:55:41,887 DEBUG [StoreOpener-0e77f96cde768bcde1fba587339782c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family1 2023-02-13 17:55:41,887 DEBUG [StoreOpener-0e77f96cde768bcde1fba587339782c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family1 2023-02-13 17:55:41,888 INFO [StoreOpener-0e77f96cde768bcde1fba587339782c6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0e77f96cde768bcde1fba587339782c6 columnFamilyName family1 2023-02-13 17:55:41,889 INFO [StoreOpener-0e77f96cde768bcde1fba587339782c6-1] regionserver.HStore(310): Store=0e77f96cde768bcde1fba587339782c6/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 17:55:41,889 INFO [StoreOpener-0e77f96cde768bcde1fba587339782c6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 0e77f96cde768bcde1fba587339782c6 2023-02-13 17:55:41,890 DEBUG [StoreOpener-0e77f96cde768bcde1fba587339782c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family2 2023-02-13 17:55:41,890 DEBUG [StoreOpener-0e77f96cde768bcde1fba587339782c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family2 2023-02-13 17:55:41,891 INFO [StoreOpener-0e77f96cde768bcde1fba587339782c6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0e77f96cde768bcde1fba587339782c6 columnFamilyName family2 2023-02-13 17:55:41,891 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in 3100400af58d7bf345cc01ad0d304911/family1 of 3100400af58d7bf345cc01ad0d304911 into be21b0a696e74a09a6b4cfd1068aecd7(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 17:55:41,891 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 3100400af58d7bf345cc01ad0d304911: 2023-02-13 17:55:41,891 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1676310940583; duration=1sec 2023-02-13 17:55:41,891 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-02-13 17:55:41,891 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-13 17:55:41,892 INFO [StoreOpener-0e77f96cde768bcde1fba587339782c6-1] regionserver.HStore(310): Store=0e77f96cde768bcde1fba587339782c6/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 17:55:41,893 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6 2023-02-13 17:55:41,893 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6 2023-02-13 17:55:41,894 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-13 17:55:41,894 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HStore(1912): bb026d2891c65ad4947af9cdbd2aee81/family2 is initiating minor compaction (all files) 2023-02-13 17:55:41,894 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of bb026d2891c65ad4947af9cdbd2aee81/family2 in testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81. 2023-02-13 17:55:41,894 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2/testCompactionWithHFileLink=bb026d2891c65ad4947af9cdbd2aee81-608fde33f61b4c5985d5cd904d692f90, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2/testCompactionWithHFileLink=bb026d2891c65ad4947af9cdbd2aee81-23f1089685c348a29b8ec869d0066855, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2/testCompactionWithHFileLink=bb026d2891c65ad4947af9cdbd2aee81-01097aa7d9cf4f0dbb75cfb2586a0995, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2/testCompactionWithHFileLink=bb026d2891c65ad4947af9cdbd2aee81-833e250a6055443d880f3a93997896df] into tmpdir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/.tmp, totalSize=20.4 K 2023-02-13 17:55:41,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 17:55:41,895 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=bb026d2891c65ad4947af9cdbd2aee81-608fde33f61b4c5985d5cd904d692f90, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676310916769 2023-02-13 17:55:41,895 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=bb026d2891c65ad4947af9cdbd2aee81-23f1089685c348a29b8ec869d0066855, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676310918550 2023-02-13 17:55:41,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 0e77f96cde768bcde1fba587339782c6 2023-02-13 17:55:41,896 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=bb026d2891c65ad4947af9cdbd2aee81-01097aa7d9cf4f0dbb75cfb2586a0995, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676310920347 2023-02-13 17:55:41,897 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=bb026d2891c65ad4947af9cdbd2aee81-833e250a6055443d880f3a93997896df, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676310922143 2023-02-13 17:55:41,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 17:55:41,898 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 0e77f96cde768bcde1fba587339782c6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66532704, jitterRate=-0.008585453033447266}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 17:55:41,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 0e77f96cde768bcde1fba587339782c6: Running coprocessor pre-open hook at 1676310941885Writing region info on filesystem at 1676310941885Initializing all the Stores at 1676310941886 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676310941886Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676310941886Cleaning up temporary data from old regions at 1676310941894 (+8 ms)Cleaning up detritus from prior splits at 1676310941894Running coprocessor post-open hooks at 1676310941898 (+4 ms)Region opened successfully at 1676310941898 2023-02-13 17:55:41,899 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,,1676310940745.0e77f96cde768bcde1fba587339782c6., pid=110, masterSystemTime=1676310941882 2023-02-13 17:55:41,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,,1676310940745.0e77f96cde768bcde1fba587339782c6. 2023-02-13 17:55:41,900 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,,1676310940745.0e77f96cde768bcde1fba587339782c6. 2023-02-13 17:55:41,900 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,1,1676310940745.226b4a6bd1e102bd425b4fe5fa7b9927. 2023-02-13 17:55:41,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 226b4a6bd1e102bd425b4fe5fa7b9927, NAME => 'ns:testMinorCompaction,1,1676310940745.226b4a6bd1e102bd425b4fe5fa7b9927.', STARTKEY => '1', ENDKEY => '2'} 2023-02-13 17:55:41,901 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 226b4a6bd1e102bd425b4fe5fa7b9927 2023-02-13 17:55:41,901 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=0e77f96cde768bcde1fba587339782c6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:41,901 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,1,1676310940745.226b4a6bd1e102bd425b4fe5fa7b9927.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 17:55:41,901 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 226b4a6bd1e102bd425b4fe5fa7b9927 2023-02-13 17:55:41,901 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,,1676310940745.0e77f96cde768bcde1fba587339782c6.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1676310941900"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676310941900"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676310941900"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676310941900"}]},"ts":"1676310941900"} 2023-02-13 17:55:41,901 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 226b4a6bd1e102bd425b4fe5fa7b9927 2023-02-13 17:55:41,902 INFO [StoreOpener-226b4a6bd1e102bd425b4fe5fa7b9927-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 226b4a6bd1e102bd425b4fe5fa7b9927 2023-02-13 17:55:41,903 DEBUG [StoreOpener-226b4a6bd1e102bd425b4fe5fa7b9927-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family1 2023-02-13 17:55:41,903 DEBUG [StoreOpener-226b4a6bd1e102bd425b4fe5fa7b9927-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family1 2023-02-13 17:55:41,904 INFO [StoreOpener-226b4a6bd1e102bd425b4fe5fa7b9927-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 226b4a6bd1e102bd425b4fe5fa7b9927 columnFamilyName family1 2023-02-13 17:55:41,904 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=110, resume processing ppid=106 2023-02-13 17:55:41,904 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=110, ppid=106, state=SUCCESS; OpenRegionProcedure 0e77f96cde768bcde1fba587339782c6, server=jenkins-hbase4.apache.org,38881,1676310818035 in 171 msec 2023-02-13 17:55:41,905 INFO [StoreOpener-226b4a6bd1e102bd425b4fe5fa7b9927-1] regionserver.HStore(310): Store=226b4a6bd1e102bd425b4fe5fa7b9927/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 17:55:41,905 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=0e77f96cde768bcde1fba587339782c6, ASSIGN in 329 msec 2023-02-13 17:55:41,905 INFO [StoreOpener-226b4a6bd1e102bd425b4fe5fa7b9927-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 226b4a6bd1e102bd425b4fe5fa7b9927 2023-02-13 17:55:41,906 DEBUG [StoreOpener-226b4a6bd1e102bd425b4fe5fa7b9927-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family2 2023-02-13 17:55:41,906 DEBUG [StoreOpener-226b4a6bd1e102bd425b4fe5fa7b9927-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family2 2023-02-13 17:55:41,907 INFO [StoreOpener-226b4a6bd1e102bd425b4fe5fa7b9927-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 226b4a6bd1e102bd425b4fe5fa7b9927 columnFamilyName family2 2023-02-13 17:55:41,907 INFO [StoreOpener-226b4a6bd1e102bd425b4fe5fa7b9927-1] regionserver.HStore(310): Store=226b4a6bd1e102bd425b4fe5fa7b9927/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 17:55:41,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927 2023-02-13 17:55:41,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927 2023-02-13 17:55:41,910 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 17:55:41,911 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] throttle.PressureAwareThroughputController(145): bb026d2891c65ad4947af9cdbd2aee81#family2#compaction#119 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 17:55:41,911 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 226b4a6bd1e102bd425b4fe5fa7b9927 2023-02-13 17:55:41,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 17:55:41,913 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 226b4a6bd1e102bd425b4fe5fa7b9927; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74297895, jitterRate=0.10712490975856781}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 17:55:41,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 226b4a6bd1e102bd425b4fe5fa7b9927: Running coprocessor pre-open hook at 1676310941901Writing region info on filesystem at 1676310941901Initializing all the Stores at 1676310941902 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676310941902Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676310941902Cleaning up temporary data from old regions at 1676310941909 (+7 ms)Cleaning up detritus from prior splits at 1676310941909Running coprocessor post-open hooks at 1676310941913 (+4 ms)Region opened successfully at 1676310941913 2023-02-13 17:55:41,914 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,1,1676310940745.226b4a6bd1e102bd425b4fe5fa7b9927., pid=111, masterSystemTime=1676310941882 2023-02-13 17:55:41,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,1,1676310940745.226b4a6bd1e102bd425b4fe5fa7b9927. 2023-02-13 17:55:41,915 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,1,1676310940745.226b4a6bd1e102bd425b4fe5fa7b9927. 2023-02-13 17:55:41,915 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,2,1676310940745.7ec577192744923b1bb4fd6145642689. 2023-02-13 17:55:41,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7ec577192744923b1bb4fd6145642689, NAME => 'ns:testMinorCompaction,2,1676310940745.7ec577192744923b1bb4fd6145642689.', STARTKEY => '2', ENDKEY => ''} 2023-02-13 17:55:41,915 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=226b4a6bd1e102bd425b4fe5fa7b9927, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:41,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 7ec577192744923b1bb4fd6145642689 2023-02-13 17:55:41,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,2,1676310940745.7ec577192744923b1bb4fd6145642689.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 17:55:41,915 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,1,1676310940745.226b4a6bd1e102bd425b4fe5fa7b9927.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1676310941915"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676310941915"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676310941915"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676310941915"}]},"ts":"1676310941915"} 2023-02-13 17:55:41,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 7ec577192744923b1bb4fd6145642689 2023-02-13 17:55:41,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 7ec577192744923b1bb4fd6145642689 2023-02-13 17:55:41,916 INFO [StoreOpener-7ec577192744923b1bb4fd6145642689-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 7ec577192744923b1bb4fd6145642689 2023-02-13 17:55:41,917 DEBUG [StoreOpener-7ec577192744923b1bb4fd6145642689-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family1 2023-02-13 17:55:41,917 DEBUG [StoreOpener-7ec577192744923b1bb4fd6145642689-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family1 2023-02-13 17:55:41,917 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=111, resume processing ppid=107 2023-02-13 17:55:41,917 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=111, ppid=107, state=SUCCESS; OpenRegionProcedure 226b4a6bd1e102bd425b4fe5fa7b9927, server=jenkins-hbase4.apache.org,38881,1676310818035 in 184 msec 2023-02-13 17:55:41,917 INFO [StoreOpener-7ec577192744923b1bb4fd6145642689-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7ec577192744923b1bb4fd6145642689 columnFamilyName family1 2023-02-13 17:55:41,918 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=226b4a6bd1e102bd425b4fe5fa7b9927, ASSIGN in 342 msec 2023-02-13 17:55:41,918 INFO [StoreOpener-7ec577192744923b1bb4fd6145642689-1] regionserver.HStore(310): Store=7ec577192744923b1bb4fd6145642689/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 17:55:41,919 INFO [StoreOpener-7ec577192744923b1bb4fd6145642689-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 7ec577192744923b1bb4fd6145642689 2023-02-13 17:55:41,919 DEBUG [StoreOpener-7ec577192744923b1bb4fd6145642689-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family2 2023-02-13 17:55:41,920 DEBUG [StoreOpener-7ec577192744923b1bb4fd6145642689-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family2 2023-02-13 17:55:41,920 INFO [StoreOpener-7ec577192744923b1bb4fd6145642689-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7ec577192744923b1bb4fd6145642689 columnFamilyName family2 2023-02-13 17:55:41,920 DEBUG [RS:0;jenkins-hbase4:38881-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/.tmp/family2/cb5d64a66fe74c91a0dc472b4220cf3e as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2/cb5d64a66fe74c91a0dc472b4220cf3e 2023-02-13 17:55:41,920 INFO [StoreOpener-7ec577192744923b1bb4fd6145642689-1] regionserver.HStore(310): Store=7ec577192744923b1bb4fd6145642689/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 17:55:41,921 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689 2023-02-13 17:55:41,921 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689 2023-02-13 17:55:41,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 17:55:41,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 7ec577192744923b1bb4fd6145642689 2023-02-13 17:55:41,925 INFO [RS:0;jenkins-hbase4:38881-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 3100400af58d7bf345cc01ad0d304911/family2 of 3100400af58d7bf345cc01ad0d304911 into cb5d64a66fe74c91a0dc472b4220cf3e(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 17:55:41,925 DEBUG [RS:0;jenkins-hbase4:38881-longCompactions-0] regionserver.HRegion(2288): Compaction status journal for 3100400af58d7bf345cc01ad0d304911: 2023-02-13 17:55:41,925 INFO [RS:0;jenkins-hbase4:38881-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911., storeName=3100400af58d7bf345cc01ad0d304911/family2, priority=12, startTime=1676310939530; duration=1sec 2023-02-13 17:55:41,925 DEBUG [RS:0;jenkins-hbase4:38881-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-02-13 17:55:41,925 DEBUG [RS:0;jenkins-hbase4:38881-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-02-13 17:55:41,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 17:55:41,925 DEBUG [RS:0;jenkins-hbase4:38881-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-02-13 17:55:41,925 DEBUG [RS:0;jenkins-hbase4:38881-longCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-02-13 17:55:41,925 DEBUG [RS:0;jenkins-hbase4:38881-longCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81. because compaction request was cancelled 2023-02-13 17:55:41,926 DEBUG [RS:0;jenkins-hbase4:38881-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-02-13 17:55:41,926 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 7ec577192744923b1bb4fd6145642689; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69579341, jitterRate=0.036812976002693176}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 17:55:41,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 7ec577192744923b1bb4fd6145642689: Running coprocessor pre-open hook at 1676310941915Writing region info on filesystem at 1676310941915Initializing all the Stores at 1676310941916 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676310941916Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676310941916Cleaning up temporary data from old regions at 1676310941922 (+6 ms)Cleaning up detritus from prior splits at 1676310941922Running coprocessor post-open hooks at 1676310941926 (+4 ms)Region opened successfully at 1676310941926 2023-02-13 17:55:41,926 DEBUG [RS:0;jenkins-hbase4:38881-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-02-13 17:55:41,926 DEBUG [RS:0;jenkins-hbase4:38881-longCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-02-13 17:55:41,926 DEBUG [RS:0;jenkins-hbase4:38881-longCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911. because compaction request was cancelled 2023-02-13 17:55:41,926 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,2,1676310940745.7ec577192744923b1bb4fd6145642689., pid=109, masterSystemTime=1676310941882 2023-02-13 17:55:41,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,2,1676310940745.7ec577192744923b1bb4fd6145642689. 2023-02-13 17:55:41,927 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,2,1676310940745.7ec577192744923b1bb4fd6145642689. 2023-02-13 17:55:41,927 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=7ec577192744923b1bb4fd6145642689, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:41,927 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,2,1676310940745.7ec577192744923b1bb4fd6145642689.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1676310941927"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676310941927"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676310941927"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676310941927"}]},"ts":"1676310941927"} 2023-02-13 17:55:41,929 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=108 2023-02-13 17:55:41,929 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=108, state=SUCCESS; OpenRegionProcedure 7ec577192744923b1bb4fd6145642689, server=jenkins-hbase4.apache.org,38881,1676310818035 in 197 msec 2023-02-13 17:55:41,930 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=105 2023-02-13 17:55:41,930 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=7ec577192744923b1bb4fd6145642689, ASSIGN in 354 msec 2023-02-13 17:55:41,931 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 17:55:41,931 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676310941931"}]},"ts":"1676310941931"} 2023-02-13 17:55:41,932 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLED in hbase:meta 2023-02-13 17:55:41,934 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 17:55:41,935 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=ns:testMinorCompaction in 1.1890 sec 2023-02-13 17:55:41,937 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/testCompactionWithHFileLink=3100400af58d7bf345cc01ad0d304911-e6560096ecd74736bebc5405b1d1b2a3, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/testCompactionWithHFileLink=3100400af58d7bf345cc01ad0d304911-2dbd654356cf49ada19b27aa5ddccb8a, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/testCompactionWithHFileLink=3100400af58d7bf345cc01ad0d304911-29b0fc5b96f14c4bacceeb69a12ebe2c, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/testCompactionWithHFileLink=3100400af58d7bf345cc01ad0d304911-cf51030f8e2f4a669ebdb6d63c1b2f69, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/88a9c510d90f4ffdbb584a8c8e45a6f6_SeqId_34_] to archive 2023-02-13 17:55:41,938 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:55:41,939 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/testCompactionWithHFileLink=3100400af58d7bf345cc01ad0d304911-e6560096ecd74736bebc5405b1d1b2a3 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/testCompactionWithHFileLink=3100400af58d7bf345cc01ad0d304911-e6560096ecd74736bebc5405b1d1b2a3 2023-02-13 17:55:41,940 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/testCompactionWithHFileLink=3100400af58d7bf345cc01ad0d304911-2dbd654356cf49ada19b27aa5ddccb8a to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/testCompactionWithHFileLink=3100400af58d7bf345cc01ad0d304911-2dbd654356cf49ada19b27aa5ddccb8a 2023-02-13 17:55:41,941 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/testCompactionWithHFileLink=3100400af58d7bf345cc01ad0d304911-29b0fc5b96f14c4bacceeb69a12ebe2c to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/testCompactionWithHFileLink=3100400af58d7bf345cc01ad0d304911-29b0fc5b96f14c4bacceeb69a12ebe2c 2023-02-13 17:55:41,942 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/testCompactionWithHFileLink=3100400af58d7bf345cc01ad0d304911-cf51030f8e2f4a669ebdb6d63c1b2f69 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/testCompactionWithHFileLink=3100400af58d7bf345cc01ad0d304911-cf51030f8e2f4a669ebdb6d63c1b2f69 2023-02-13 17:55:41,942 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/88a9c510d90f4ffdbb584a8c8e45a6f6_SeqId_34_ to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family1/88a9c510d90f4ffdbb584a8c8e45a6f6_SeqId_34_ 2023-02-13 17:55:41,944 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2/testCompactionWithHFileLink=3100400af58d7bf345cc01ad0d304911-32c4ec93ee254178b71387a374784c01, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2/testCompactionWithHFileLink=3100400af58d7bf345cc01ad0d304911-8be2efbf57b743b085c80dd2eb0afaa9, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2/testCompactionWithHFileLink=3100400af58d7bf345cc01ad0d304911-46a65080c58e40959b6f072bbd556cb4, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2/testCompactionWithHFileLink=3100400af58d7bf345cc01ad0d304911-e06eec59679249679bbc717b4a660668] to archive 2023-02-13 17:55:41,944 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:55:41,945 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2/testCompactionWithHFileLink=3100400af58d7bf345cc01ad0d304911-32c4ec93ee254178b71387a374784c01 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2/testCompactionWithHFileLink=3100400af58d7bf345cc01ad0d304911-32c4ec93ee254178b71387a374784c01 2023-02-13 17:55:41,946 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2/testCompactionWithHFileLink=3100400af58d7bf345cc01ad0d304911-8be2efbf57b743b085c80dd2eb0afaa9 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2/testCompactionWithHFileLink=3100400af58d7bf345cc01ad0d304911-8be2efbf57b743b085c80dd2eb0afaa9 2023-02-13 17:55:41,947 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2/testCompactionWithHFileLink=3100400af58d7bf345cc01ad0d304911-46a65080c58e40959b6f072bbd556cb4 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2/testCompactionWithHFileLink=3100400af58d7bf345cc01ad0d304911-46a65080c58e40959b6f072bbd556cb4 2023-02-13 17:55:41,948 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2/testCompactionWithHFileLink=3100400af58d7bf345cc01ad0d304911-e06eec59679249679bbc717b4a660668 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/family2/testCompactionWithHFileLink=3100400af58d7bf345cc01ad0d304911-e06eec59679249679bbc717b4a660668 2023-02-13 17:55:42,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-13 17:55:42,853 INFO [Listener at localhost/35343] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: ns:testMinorCompaction, procId: 105 completed 2023-02-13 17:55:42,858 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,,1676310940745.0e77f96cde768bcde1fba587339782c6. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 17:55:42,859 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,1,1676310940745.226b4a6bd1e102bd425b4fe5fa7b9927. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 17:55:42,859 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,2,1676310940745.7ec577192744923b1bb4fd6145642689. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 17:55:42,861 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:55:42,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-13 17:55:42,862 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-13 17:55:42,862 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:55:42,862 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-13 17:55:42,862 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-13 17:55:42,863 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 17:55:42,863 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 17:55:42,864 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:42,864 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:55:42,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:55:42,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:55:42,864 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:42,864 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:55:42,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 17:55:42,865 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 17:55:42,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:55:42,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 17:55:42,865 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-13 17:55:42,865 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-13 17:55:42,865 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-13 17:55:42,865 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:55:42,865 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-13 17:55:42,868 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1676310940745.226b4a6bd1e102bd425b4fe5fa7b9927. 2023-02-13 17:55:42,868 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1676310940745.226b4a6bd1e102bd425b4fe5fa7b9927. started... 2023-02-13 17:55:42,869 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1676310940745.0e77f96cde768bcde1fba587339782c6. 2023-02-13 17:55:42,869 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 17:55:42,869 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:55:42,869 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1676310940745.0e77f96cde768bcde1fba587339782c6. started... 2023-02-13 17:55:42,869 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 226b4a6bd1e102bd425b4fe5fa7b9927 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-13 17:55:42,869 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1676310940745.7ec577192744923b1bb4fd6145642689. 2023-02-13 17:55:42,870 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 0e77f96cde768bcde1fba587339782c6 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-13 17:55:42,870 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1676310940745.7ec577192744923b1bb4fd6145642689. started... 2023-02-13 17:55:42,870 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 7ec577192744923b1bb4fd6145642689 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-13 17:55:43,127 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/.tmp/family2/b808693cd65b4b17bed9eec7d874ad32 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2/b808693cd65b4b17bed9eec7d874ad32 2023-02-13 17:55:43,130 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in bb026d2891c65ad4947af9cdbd2aee81/family2 of bb026d2891c65ad4947af9cdbd2aee81 into b808693cd65b4b17bed9eec7d874ad32(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 17:55:43,131 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for bb026d2891c65ad4947af9cdbd2aee81: 2023-02-13 17:55:43,131 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81., storeName=bb026d2891c65ad4947af9cdbd2aee81/family2, priority=12, startTime=1676310939466; duration=1sec 2023-02-13 17:55:43,131 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 17:55:43,141 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2/testCompactionWithHFileLink=bb026d2891c65ad4947af9cdbd2aee81-608fde33f61b4c5985d5cd904d692f90, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2/testCompactionWithHFileLink=bb026d2891c65ad4947af9cdbd2aee81-23f1089685c348a29b8ec869d0066855, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2/testCompactionWithHFileLink=bb026d2891c65ad4947af9cdbd2aee81-01097aa7d9cf4f0dbb75cfb2586a0995, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2/testCompactionWithHFileLink=bb026d2891c65ad4947af9cdbd2aee81-833e250a6055443d880f3a93997896df] to archive 2023-02-13 17:55:43,141 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:55:43,142 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2/testCompactionWithHFileLink=bb026d2891c65ad4947af9cdbd2aee81-608fde33f61b4c5985d5cd904d692f90 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2/testCompactionWithHFileLink=bb026d2891c65ad4947af9cdbd2aee81-608fde33f61b4c5985d5cd904d692f90 2023-02-13 17:55:43,143 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2/testCompactionWithHFileLink=bb026d2891c65ad4947af9cdbd2aee81-23f1089685c348a29b8ec869d0066855 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2/testCompactionWithHFileLink=bb026d2891c65ad4947af9cdbd2aee81-23f1089685c348a29b8ec869d0066855 2023-02-13 17:55:43,144 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2/testCompactionWithHFileLink=bb026d2891c65ad4947af9cdbd2aee81-01097aa7d9cf4f0dbb75cfb2586a0995 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2/testCompactionWithHFileLink=bb026d2891c65ad4947af9cdbd2aee81-01097aa7d9cf4f0dbb75cfb2586a0995 2023-02-13 17:55:43,145 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2/testCompactionWithHFileLink=bb026d2891c65ad4947af9cdbd2aee81-833e250a6055443d880f3a93997896df to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/family2/testCompactionWithHFileLink=bb026d2891c65ad4947af9cdbd2aee81-833e250a6055443d880f3a93997896df 2023-02-13 17:55:43,281 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213519d52fc2f1f4ed09688a5859ffefaf8 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230213519d52fc2f1f4ed09688a5859ffefaf8 2023-02-13 17:55:43,281 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213c5e5e5573ce94ecdaefd6141167237b6 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230213c5e5e5573ce94ecdaefd6141167237b6 2023-02-13 17:55:43,281 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302138390e7c0491c4190a41be5185813eff9 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202302138390e7c0491c4190a41be5185813eff9 2023-02-13 17:55:43,290 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/.tmp/family1/ed7e2345afbd4f5ca54a03422acb785d 2023-02-13 17:55:43,691 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/.tmp/family1/17fa94c5e75a409bbbf673ead018e4b7 2023-02-13 17:55:43,691 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/.tmp/family1/1eafba220f60459ea4d67f22915d2d18 2023-02-13 17:55:43,702 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302130d8cba282eeb4db697accefb65257df2 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202302130d8cba282eeb4db697accefb65257df2 2023-02-13 17:55:44,105 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213e69ca504ab614744933a4e45ec3f7aff to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230213e69ca504ab614744933a4e45ec3f7aff 2023-02-13 17:55:44,105 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021319645ed21327460b8de04505a6c6a4d3 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c2023021319645ed21327460b8de04505a6c6a4d3 2023-02-13 17:55:44,107 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/.tmp/family2/cf785a703ff24442bfbd5b2e850fc8a6 2023-02-13 17:55:44,111 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/.tmp/family1/ed7e2345afbd4f5ca54a03422acb785d as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family1/ed7e2345afbd4f5ca54a03422acb785d 2023-02-13 17:55:44,114 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family1/ed7e2345afbd4f5ca54a03422acb785d, entries=4, sequenceid=5, filesize=5.4 K 2023-02-13 17:55:44,114 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/.tmp/family2/cf785a703ff24442bfbd5b2e850fc8a6 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family2/cf785a703ff24442bfbd5b2e850fc8a6 2023-02-13 17:55:44,117 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family2/cf785a703ff24442bfbd5b2e850fc8a6, entries=2, sequenceid=5, filesize=5.1 K 2023-02-13 17:55:44,118 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 0e77f96cde768bcde1fba587339782c6 in 1248ms, sequenceid=5, compaction requested=false 2023-02-13 17:55:44,118 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-02-13 17:55:44,118 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 0e77f96cde768bcde1fba587339782c6: 2023-02-13 17:55:44,118 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1676310940745.0e77f96cde768bcde1fba587339782c6. 2023-02-13 17:55:44,118 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 17:55:44,510 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/.tmp/family2/f05e9a522aa54fc58d73499d426cf0da 2023-02-13 17:55:44,510 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/.tmp/family2/9eed95bdbba34429b0ffe8ac98a8d428 2023-02-13 17:55:44,514 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/.tmp/family1/1eafba220f60459ea4d67f22915d2d18 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family1/1eafba220f60459ea4d67f22915d2d18 2023-02-13 17:55:44,514 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/.tmp/family1/17fa94c5e75a409bbbf673ead018e4b7 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family1/17fa94c5e75a409bbbf673ead018e4b7 2023-02-13 17:55:44,517 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family1/1eafba220f60459ea4d67f22915d2d18, entries=4, sequenceid=5, filesize=5.4 K 2023-02-13 17:55:44,517 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family1/17fa94c5e75a409bbbf673ead018e4b7, entries=4, sequenceid=5, filesize=5.4 K 2023-02-13 17:55:44,517 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/.tmp/family2/9eed95bdbba34429b0ffe8ac98a8d428 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family2/9eed95bdbba34429b0ffe8ac98a8d428 2023-02-13 17:55:44,517 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/.tmp/family2/f05e9a522aa54fc58d73499d426cf0da as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family2/f05e9a522aa54fc58d73499d426cf0da 2023-02-13 17:55:44,520 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family2/9eed95bdbba34429b0ffe8ac98a8d428, entries=2, sequenceid=5, filesize=5.1 K 2023-02-13 17:55:44,520 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family2/f05e9a522aa54fc58d73499d426cf0da, entries=2, sequenceid=5, filesize=5.1 K 2023-02-13 17:55:44,521 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 7ec577192744923b1bb4fd6145642689 in 1651ms, sequenceid=5, compaction requested=false 2023-02-13 17:55:44,521 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 226b4a6bd1e102bd425b4fe5fa7b9927 in 1652ms, sequenceid=5, compaction requested=false 2023-02-13 17:55:44,522 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 7ec577192744923b1bb4fd6145642689: 2023-02-13 17:55:44,522 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 226b4a6bd1e102bd425b4fe5fa7b9927: 2023-02-13 17:55:44,522 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1676310940745.7ec577192744923b1bb4fd6145642689. 2023-02-13 17:55:44,522 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1676310940745.226b4a6bd1e102bd425b4fe5fa7b9927. 2023-02-13 17:55:44,522 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 17:55:44,522 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 17:55:44,522 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 17:55:44,522 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:44,522 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-13 17:55:44,522 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-13 17:55:44,524 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:44,524 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 17:55:44,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:44,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:55:44,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:55:44,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:55:44,524 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 17:55:44,524 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:55:44,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:55:44,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 17:55:44,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:44,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:55:44,525 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-13 17:55:44,525 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@27ba410a[Count = 0] remaining members to acquire global barrier 2023-02-13 17:55:44,525 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-13 17:55:44,525 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 17:55:44,526 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 17:55:44,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 17:55:44,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 17:55:44,526 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-13 17:55:44,526 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-13 17:55:44,526 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:55:44,526 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:44,526 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:55:44,529 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:44,529 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-13 17:55:44,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:44,529 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:55:44,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:55:44,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:55:44,529 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-13 17:55:44,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:55:44,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:55:44,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 17:55:44,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:44,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:55:44,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 17:55:44,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:44,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:55:44,531 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-13 17:55:44,531 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-13 17:55:44,531 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:55:44,531 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:55:44,531 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-13 17:55:44,531 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:55:44,532 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 17:55:44,532 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 17:55:44,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 17:55:44,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 17:55:44,532 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:55:44,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 17:55:44,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:55:44,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:55:44,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:55:44,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:55:44,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:55:44,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 17:55:44,533 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:44,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 17:55:44,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:55:44,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 17:55:44,534 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:44,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:44,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:55:44,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 17:55:44,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:44,536 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:44,536 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 17:55:44,536 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:55:44,536 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:55:44,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:55:44,536 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 17:55:44,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:55:44,536 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:55:44,536 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-13 17:55:44,536 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:55:44,536 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:44,536 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 17:55:44,536 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 17:55:44,536 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 17:55:44,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:55:44,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:55:44,536 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-13 17:55:44,536 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:55:44,637 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:55:44,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:55:44,639 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,,1676310940745.0e77f96cde768bcde1fba587339782c6. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 17:55:44,639 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,1,1676310940745.226b4a6bd1e102bd425b4fe5fa7b9927. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 17:55:44,639 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,2,1676310940745.7ec577192744923b1bb4fd6145642689. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 17:55:44,641 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:55:44,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-02-13 17:55:44,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-13 17:55:44,643 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-13 17:55:44,643 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:55:44,643 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-13 17:55:44,643 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-13 17:55:44,644 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 17:55:44,644 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 17:55:44,645 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:44,645 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:55:44,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:55:44,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:55:44,645 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:44,645 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:55:44,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 17:55:44,645 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 17:55:44,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:55:44,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 17:55:44,646 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-13 17:55:44,646 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-02-13 17:55:44,646 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-13 17:55:44,646 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-13 17:55:44,646 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:55:44,646 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-13 17:55:44,646 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1676310940745.226b4a6bd1e102bd425b4fe5fa7b9927. 2023-02-13 17:55:44,646 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1676310940745.0e77f96cde768bcde1fba587339782c6. 2023-02-13 17:55:44,646 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 17:55:44,647 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:55:44,647 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1676310940745.0e77f96cde768bcde1fba587339782c6. started... 2023-02-13 17:55:44,646 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1676310940745.226b4a6bd1e102bd425b4fe5fa7b9927. started... 2023-02-13 17:55:44,647 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1676310940745.7ec577192744923b1bb4fd6145642689. 2023-02-13 17:55:44,647 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1676310940745.7ec577192744923b1bb4fd6145642689. started... 2023-02-13 17:55:44,647 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 0e77f96cde768bcde1fba587339782c6 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-13 17:55:44,647 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 226b4a6bd1e102bd425b4fe5fa7b9927 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-13 17:55:44,647 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 7ec577192744923b1bb4fd6145642689 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-13 17:55:45,060 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213c44ab83140e446c5973d7a6ee1f2abbd to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230213c44ab83140e446c5973d7a6ee1f2abbd 2023-02-13 17:55:45,060 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213fe6162e670cd4e4eaaea674ef0c91eb3 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230213fe6162e670cd4e4eaaea674ef0c91eb3 2023-02-13 17:55:45,060 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213f325b2d8325b4c8c8d6babf01fedb5e5 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230213f325b2d8325b4c8c8d6babf01fedb5e5 2023-02-13 17:55:45,469 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/.tmp/family1/c009fe17409b493e94563c6415ac9b3d 2023-02-13 17:55:45,469 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/.tmp/family1/d31f14b450164c569ee386796b39608d 2023-02-13 17:55:45,470 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/.tmp/family1/9dc23ece6fa14dd0baadd4d110db0d6b 2023-02-13 17:55:45,889 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302137f352723637d479bbf7379fd3d64369c to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202302137f352723637d479bbf7379fd3d64369c 2023-02-13 17:55:45,889 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021398f3a86c02e5474ca355b1821432b2dd to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b2023021398f3a86c02e5474ca355b1821432b2dd 2023-02-13 17:55:45,889 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213ca51be9c71f54533ac46878a5752eea3 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230213ca51be9c71f54533ac46878a5752eea3 2023-02-13 17:55:46,298 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/.tmp/family2/a99195129c6e46c79b484bd4f388db84 2023-02-13 17:55:46,302 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/.tmp/family2/4e77638cb65d42fb9f7e31a19fa20e33 2023-02-13 17:55:46,302 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/.tmp/family2/aef9e734e4f4465a83b91bd8bbf12513 2023-02-13 17:55:46,302 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/.tmp/family1/d31f14b450164c569ee386796b39608d as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family1/d31f14b450164c569ee386796b39608d 2023-02-13 17:55:46,305 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family1/d31f14b450164c569ee386796b39608d, entries=4, sequenceid=9, filesize=5.4 K 2023-02-13 17:55:46,305 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/.tmp/family1/c009fe17409b493e94563c6415ac9b3d as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family1/c009fe17409b493e94563c6415ac9b3d 2023-02-13 17:55:46,305 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/.tmp/family1/9dc23ece6fa14dd0baadd4d110db0d6b as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family1/9dc23ece6fa14dd0baadd4d110db0d6b 2023-02-13 17:55:46,306 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/.tmp/family2/a99195129c6e46c79b484bd4f388db84 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family2/a99195129c6e46c79b484bd4f388db84 2023-02-13 17:55:46,309 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family1/c009fe17409b493e94563c6415ac9b3d, entries=4, sequenceid=9, filesize=5.4 K 2023-02-13 17:55:46,309 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family1/9dc23ece6fa14dd0baadd4d110db0d6b, entries=4, sequenceid=9, filesize=5.4 K 2023-02-13 17:55:46,310 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family2/a99195129c6e46c79b484bd4f388db84, entries=2, sequenceid=9, filesize=5.1 K 2023-02-13 17:55:46,310 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/.tmp/family2/aef9e734e4f4465a83b91bd8bbf12513 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family2/aef9e734e4f4465a83b91bd8bbf12513 2023-02-13 17:55:46,310 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/.tmp/family2/4e77638cb65d42fb9f7e31a19fa20e33 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family2/4e77638cb65d42fb9f7e31a19fa20e33 2023-02-13 17:55:46,310 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 0e77f96cde768bcde1fba587339782c6 in 1663ms, sequenceid=9, compaction requested=false 2023-02-13 17:55:46,311 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 0e77f96cde768bcde1fba587339782c6: 2023-02-13 17:55:46,311 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1676310940745.0e77f96cde768bcde1fba587339782c6. 2023-02-13 17:55:46,311 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 17:55:46,313 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family2/aef9e734e4f4465a83b91bd8bbf12513, entries=2, sequenceid=9, filesize=5.1 K 2023-02-13 17:55:46,314 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family2/4e77638cb65d42fb9f7e31a19fa20e33, entries=2, sequenceid=9, filesize=5.1 K 2023-02-13 17:55:46,314 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 7ec577192744923b1bb4fd6145642689 in 1667ms, sequenceid=9, compaction requested=false 2023-02-13 17:55:46,314 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 226b4a6bd1e102bd425b4fe5fa7b9927 in 1667ms, sequenceid=9, compaction requested=false 2023-02-13 17:55:46,314 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 7ec577192744923b1bb4fd6145642689: 2023-02-13 17:55:46,314 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 226b4a6bd1e102bd425b4fe5fa7b9927: 2023-02-13 17:55:46,314 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1676310940745.226b4a6bd1e102bd425b4fe5fa7b9927. 2023-02-13 17:55:46,314 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1676310940745.7ec577192744923b1bb4fd6145642689. 2023-02-13 17:55:46,314 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 17:55:46,314 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 17:55:46,315 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 17:55:46,315 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:46,315 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-13 17:55:46,315 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-13 17:55:46,318 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:46,318 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 17:55:46,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:46,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:55:46,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:55:46,318 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 17:55:46,318 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:55:46,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:55:46,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:55:46,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 17:55:46,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:46,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:55:46,319 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-13 17:55:46,319 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@12ddf4d[Count = 0] remaining members to acquire global barrier 2023-02-13 17:55:46,319 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-13 17:55:46,319 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 17:55:46,320 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 17:55:46,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 17:55:46,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 17:55:46,321 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-13 17:55:46,321 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-13 17:55:46,321 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:46,321 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:55:46,321 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:55:46,325 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:46,325 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-13 17:55:46,325 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:55:46,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:46,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:55:46,325 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-13 17:55:46,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:55:46,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:55:46,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:55:46,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 17:55:46,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:46,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:55:46,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 17:55:46,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:46,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:55:46,327 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-13 17:55:46,327 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-13 17:55:46,327 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:55:46,327 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:55:46,327 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-13 17:55:46,327 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:55:46,328 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 17:55:46,328 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 17:55:46,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 17:55:46,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:55:46,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:55:46,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 17:55:46,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 17:55:46,328 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:55:46,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:55:46,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:55:46,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:55:46,329 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:46,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 17:55:46,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 17:55:46,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:55:46,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 17:55:46,330 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:46,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:46,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:55:46,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 17:55:46,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:46,332 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:46,332 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:55:46,332 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 17:55:46,332 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:55:46,333 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:55:46,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:55:46,333 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-13 17:55:46,333 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-02-13 17:55:46,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:55:46,333 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 17:55:46,333 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:55:46,333 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:46,333 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 17:55:46,333 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 17:55:46,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:55:46,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:55:46,333 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 17:55:46,333 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-13 17:55:46,333 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:55:46,433 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:55:46,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:55:46,435 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,,1676310940745.0e77f96cde768bcde1fba587339782c6. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 17:55:46,435 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,1,1676310940745.226b4a6bd1e102bd425b4fe5fa7b9927. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 17:55:46,436 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,2,1676310940745.7ec577192744923b1bb4fd6145642689. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 17:55:46,438 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:55:46,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-02-13 17:55:46,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-13 17:55:46,439 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-13 17:55:46,439 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:55:46,439 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-13 17:55:46,439 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-13 17:55:46,440 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 17:55:46,440 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 17:55:46,441 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:55:46,441 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:46,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:55:46,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:55:46,441 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:46,441 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:55:46,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 17:55:46,441 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 17:55:46,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:55:46,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 17:55:46,442 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-13 17:55:46,442 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-02-13 17:55:46,442 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-13 17:55:46,442 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-13 17:55:46,442 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:55:46,442 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-13 17:55:46,442 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1676310940745.226b4a6bd1e102bd425b4fe5fa7b9927. 2023-02-13 17:55:46,442 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1676310940745.0e77f96cde768bcde1fba587339782c6. 2023-02-13 17:55:46,442 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1676310940745.0e77f96cde768bcde1fba587339782c6. started... 2023-02-13 17:55:46,442 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1676310940745.7ec577192744923b1bb4fd6145642689. 2023-02-13 17:55:46,442 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1676310940745.7ec577192744923b1bb4fd6145642689. started... 2023-02-13 17:55:46,442 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1676310940745.226b4a6bd1e102bd425b4fe5fa7b9927. started... 2023-02-13 17:55:46,442 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 17:55:46,443 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:55:46,443 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 226b4a6bd1e102bd425b4fe5fa7b9927 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-13 17:55:46,442 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 7ec577192744923b1bb4fd6145642689 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-13 17:55:46,442 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 0e77f96cde768bcde1fba587339782c6 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-13 17:55:46,857 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021330753f6dc4254ab083a515f801d1e5c3 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023021330753f6dc4254ab083a515f801d1e5c3 2023-02-13 17:55:46,857 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213a68972caa3a24274ba730c2bf4196b70 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230213a68972caa3a24274ba730c2bf4196b70 2023-02-13 17:55:46,857 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213711606ea06214625841da2902f10a587 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230213711606ea06214625841da2902f10a587 2023-02-13 17:55:46,862 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/.tmp/family1/3c7bacf5237b4039b87295d634fc8054 2023-02-13 17:55:47,262 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/.tmp/family1/b4af81ddcf0e4713b0bcd371a232c8d6 2023-02-13 17:55:47,262 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/.tmp/family1/a77c811d355e42889f7360d53224e782 2023-02-13 17:55:47,273 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213449702535f3240e7ada031139924af92 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230213449702535f3240e7ada031139924af92 2023-02-13 17:55:47,387 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 17:55:47,675 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302138c6485943f29416a874e41797cba64c6 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202302138c6485943f29416a874e41797cba64c6 2023-02-13 17:55:47,675 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213e20d168053d94498bbb412f75ecd0d16 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230213e20d168053d94498bbb412f75ecd0d16 2023-02-13 17:55:47,677 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/.tmp/family2/a86f53c24e8748deb4d5c54bba853823 2023-02-13 17:55:47,680 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/.tmp/family1/3c7bacf5237b4039b87295d634fc8054 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family1/3c7bacf5237b4039b87295d634fc8054 2023-02-13 17:55:47,683 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family1/3c7bacf5237b4039b87295d634fc8054, entries=4, sequenceid=13, filesize=5.4 K 2023-02-13 17:55:47,684 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/.tmp/family2/a86f53c24e8748deb4d5c54bba853823 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family2/a86f53c24e8748deb4d5c54bba853823 2023-02-13 17:55:47,686 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family2/a86f53c24e8748deb4d5c54bba853823, entries=2, sequenceid=13, filesize=5.1 K 2023-02-13 17:55:47,687 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 226b4a6bd1e102bd425b4fe5fa7b9927 in 1245ms, sequenceid=13, compaction requested=true 2023-02-13 17:55:47,687 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 226b4a6bd1e102bd425b4fe5fa7b9927: 2023-02-13 17:55:47,687 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1676310940745.226b4a6bd1e102bd425b4fe5fa7b9927. 2023-02-13 17:55:47,687 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 17:55:48,079 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/.tmp/family2/0af1edb72f6c49b5b63de32639225e9c 2023-02-13 17:55:48,080 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/.tmp/family2/30c658a6b0b143ba8b93456e7f89f439 2023-02-13 17:55:48,083 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/.tmp/family1/a77c811d355e42889f7360d53224e782 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family1/a77c811d355e42889f7360d53224e782 2023-02-13 17:55:48,083 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/.tmp/family1/b4af81ddcf0e4713b0bcd371a232c8d6 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family1/b4af81ddcf0e4713b0bcd371a232c8d6 2023-02-13 17:55:48,086 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family1/a77c811d355e42889f7360d53224e782, entries=4, sequenceid=13, filesize=5.4 K 2023-02-13 17:55:48,087 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family1/b4af81ddcf0e4713b0bcd371a232c8d6, entries=4, sequenceid=13, filesize=5.4 K 2023-02-13 17:55:48,087 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/.tmp/family2/30c658a6b0b143ba8b93456e7f89f439 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family2/30c658a6b0b143ba8b93456e7f89f439 2023-02-13 17:55:48,087 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/.tmp/family2/0af1edb72f6c49b5b63de32639225e9c as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family2/0af1edb72f6c49b5b63de32639225e9c 2023-02-13 17:55:48,090 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family2/30c658a6b0b143ba8b93456e7f89f439, entries=2, sequenceid=13, filesize=5.1 K 2023-02-13 17:55:48,091 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family2/0af1edb72f6c49b5b63de32639225e9c, entries=2, sequenceid=13, filesize=5.1 K 2023-02-13 17:55:48,091 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 7ec577192744923b1bb4fd6145642689 in 1649ms, sequenceid=13, compaction requested=true 2023-02-13 17:55:48,091 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 0e77f96cde768bcde1fba587339782c6 in 1649ms, sequenceid=13, compaction requested=true 2023-02-13 17:55:48,091 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 7ec577192744923b1bb4fd6145642689: 2023-02-13 17:55:48,091 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 0e77f96cde768bcde1fba587339782c6: 2023-02-13 17:55:48,091 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1676310940745.7ec577192744923b1bb4fd6145642689. 2023-02-13 17:55:48,091 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1676310940745.0e77f96cde768bcde1fba587339782c6. 2023-02-13 17:55:48,091 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 17:55:48,091 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 17:55:48,091 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 17:55:48,091 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:48,091 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-13 17:55:48,091 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-13 17:55:48,094 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 17:55:48,094 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:48,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:48,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:55:48,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:55:48,094 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 17:55:48,094 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:55:48,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:55:48,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:55:48,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 17:55:48,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:48,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:55:48,095 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-13 17:55:48,095 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4265319c[Count = 0] remaining members to acquire global barrier 2023-02-13 17:55:48,095 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-13 17:55:48,095 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 17:55:48,096 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 17:55:48,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 17:55:48,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 17:55:48,096 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-13 17:55:48,096 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-13 17:55:48,096 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:48,096 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:55:48,096 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:55:48,098 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:48,098 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-13 17:55:48,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:48,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:55:48,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:55:48,098 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:55:48,098 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-13 17:55:48,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:55:48,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:55:48,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 17:55:48,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:48,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:55:48,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 17:55:48,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:48,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:55:48,100 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-13 17:55:48,100 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-13 17:55:48,100 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:55:48,100 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:55:48,100 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-13 17:55:48,100 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:55:48,101 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 17:55:48,101 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 17:55:48,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 17:55:48,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 17:55:48,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:55:48,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:55:48,101 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:55:48,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 17:55:48,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:55:48,101 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:48,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:55:48,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:55:48,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 17:55:48,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 17:55:48,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:55:48,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 17:55:48,102 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:48,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:48,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:55:48,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 17:55:48,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:48,106 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:48,106 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:55:48,106 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 17:55:48,106 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:55:48,106 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-02-13 17:55:48,106 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-13 17:55:48,106 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:55:48,106 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 17:55:48,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:55:48,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:55:48,106 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:55:48,106 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:48,106 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 17:55:48,106 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 17:55:48,106 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-13 17:55:48,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:55:48,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:55:48,106 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:55:48,106 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 17:55:48,206 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:55:48,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:55:48,208 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,,1676310940745.0e77f96cde768bcde1fba587339782c6. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 17:55:48,209 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,1,1676310940745.226b4a6bd1e102bd425b4fe5fa7b9927. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 17:55:48,209 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,2,1676310940745.7ec577192744923b1bb4fd6145642689. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 17:55:48,211 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:55:48,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-02-13 17:55:48,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-13 17:55:48,212 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-13 17:55:48,212 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:55:48,212 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-13 17:55:48,212 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-13 17:55:48,213 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 17:55:48,213 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 17:55:48,214 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:48,214 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:55:48,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:55:48,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:55:48,215 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:48,215 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:55:48,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 17:55:48,215 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 17:55:48,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:55:48,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 17:55:48,215 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-13 17:55:48,215 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-02-13 17:55:48,215 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-13 17:55:48,216 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-13 17:55:48,216 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:55:48,216 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-13 17:55:48,216 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1676310940745.226b4a6bd1e102bd425b4fe5fa7b9927. 2023-02-13 17:55:48,216 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1676310940745.226b4a6bd1e102bd425b4fe5fa7b9927. started... 2023-02-13 17:55:48,216 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 17:55:48,216 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:55:48,216 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 226b4a6bd1e102bd425b4fe5fa7b9927 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-13 17:55:48,216 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1676310940745.0e77f96cde768bcde1fba587339782c6. 2023-02-13 17:55:48,216 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1676310940745.7ec577192744923b1bb4fd6145642689. 2023-02-13 17:55:48,216 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1676310940745.0e77f96cde768bcde1fba587339782c6. started... 2023-02-13 17:55:48,216 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1676310940745.7ec577192744923b1bb4fd6145642689. started... 2023-02-13 17:55:48,216 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 0e77f96cde768bcde1fba587339782c6 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-13 17:55:48,216 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 7ec577192744923b1bb4fd6145642689 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-13 17:55:48,229 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213f82b8e00b0d3482a94f29e7b39537b8c to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230213f82b8e00b0d3482a94f29e7b39537b8c 2023-02-13 17:55:48,629 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021360454a25d26e41249b88fb2dcf49099c to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023021360454a25d26e41249b88fb2dcf49099c 2023-02-13 17:55:48,630 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213d773f4c2438a4e33997ec724008b05c6 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230213d773f4c2438a4e33997ec724008b05c6 2023-02-13 17:55:48,636 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/.tmp/family1/030870c2c0c14456b44be564d96d3d7c 2023-02-13 17:55:49,034 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/.tmp/family1/8a2ab61833b847059309f0326abd18df 2023-02-13 17:55:49,034 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/.tmp/family1/baed9c63d14f409086687c06ba0e8a4a 2023-02-13 17:55:49,050 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302136fc5da82ece84c25ab880c46e5e8c254 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202302136fc5da82ece84c25ab880c46e5e8c254 2023-02-13 17:55:49,449 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021373b066905b2141c2b049d11e04b35dd2 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e2023021373b066905b2141c2b049d11e04b35dd2 2023-02-13 17:55:49,452 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302132d1008487b07436e896bed1bcc3108ff to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202302132d1008487b07436e896bed1bcc3108ff 2023-02-13 17:55:49,453 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/.tmp/family2/6cd7735cc17d4db49c8fb93236b84156 2023-02-13 17:55:49,455 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/.tmp/family2/04337e39bb084893a46e42932f404744 2023-02-13 17:55:49,457 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/.tmp/family2/c8c96865ae594556aac0383125214cea 2023-02-13 17:55:49,457 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/.tmp/family1/baed9c63d14f409086687c06ba0e8a4a as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family1/baed9c63d14f409086687c06ba0e8a4a 2023-02-13 17:55:49,458 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/.tmp/family1/030870c2c0c14456b44be564d96d3d7c as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family1/030870c2c0c14456b44be564d96d3d7c 2023-02-13 17:55:49,460 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/.tmp/family1/8a2ab61833b847059309f0326abd18df as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family1/8a2ab61833b847059309f0326abd18df 2023-02-13 17:55:49,461 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family1/baed9c63d14f409086687c06ba0e8a4a, entries=4, sequenceid=17, filesize=5.4 K 2023-02-13 17:55:49,461 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/.tmp/family2/6cd7735cc17d4db49c8fb93236b84156 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family2/6cd7735cc17d4db49c8fb93236b84156 2023-02-13 17:55:49,462 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family1/030870c2c0c14456b44be564d96d3d7c, entries=4, sequenceid=17, filesize=5.4 K 2023-02-13 17:55:49,462 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/.tmp/family2/04337e39bb084893a46e42932f404744 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family2/04337e39bb084893a46e42932f404744 2023-02-13 17:55:49,464 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family1/8a2ab61833b847059309f0326abd18df, entries=4, sequenceid=17, filesize=5.4 K 2023-02-13 17:55:49,464 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/.tmp/family2/c8c96865ae594556aac0383125214cea as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family2/c8c96865ae594556aac0383125214cea 2023-02-13 17:55:49,466 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family2/6cd7735cc17d4db49c8fb93236b84156, entries=2, sequenceid=17, filesize=5.1 K 2023-02-13 17:55:49,466 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family2/04337e39bb084893a46e42932f404744, entries=2, sequenceid=17, filesize=5.1 K 2023-02-13 17:55:49,466 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 0e77f96cde768bcde1fba587339782c6 in 1250ms, sequenceid=17, compaction requested=true 2023-02-13 17:55:49,466 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 0e77f96cde768bcde1fba587339782c6: 2023-02-13 17:55:49,466 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1676310940745.0e77f96cde768bcde1fba587339782c6. 2023-02-13 17:55:49,466 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 226b4a6bd1e102bd425b4fe5fa7b9927 in 1250ms, sequenceid=17, compaction requested=true 2023-02-13 17:55:49,466 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 17:55:49,467 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 226b4a6bd1e102bd425b4fe5fa7b9927: 2023-02-13 17:55:49,467 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1676310940745.226b4a6bd1e102bd425b4fe5fa7b9927. 2023-02-13 17:55:49,467 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 17:55:49,469 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family2/c8c96865ae594556aac0383125214cea, entries=2, sequenceid=17, filesize=5.1 K 2023-02-13 17:55:49,469 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 7ec577192744923b1bb4fd6145642689 in 1253ms, sequenceid=17, compaction requested=true 2023-02-13 17:55:49,469 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 7ec577192744923b1bb4fd6145642689: 2023-02-13 17:55:49,469 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1676310940745.7ec577192744923b1bb4fd6145642689. 2023-02-13 17:55:49,470 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 17:55:49,470 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 17:55:49,470 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:49,470 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-13 17:55:49,470 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-13 17:55:49,471 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 17:55:49,471 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:49,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:49,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:55:49,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:55:49,471 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 17:55:49,472 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:55:49,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:55:49,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:55:49,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 17:55:49,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:49,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:55:49,473 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-13 17:55:49,473 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@30e47aef[Count = 0] remaining members to acquire global barrier 2023-02-13 17:55:49,473 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-13 17:55:49,473 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 17:55:49,474 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 17:55:49,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 17:55:49,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 17:55:49,474 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-13 17:55:49,474 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:49,474 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-13 17:55:49,474 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:55:49,474 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:55:49,476 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:49,476 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-13 17:55:49,476 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:55:49,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:49,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:55:49,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:55:49,476 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-13 17:55:49,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:55:49,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:55:49,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 17:55:49,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:49,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:55:49,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 17:55:49,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:49,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:55:49,478 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-13 17:55:49,478 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-13 17:55:49,478 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:55:49,478 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:55:49,478 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-13 17:55:49,478 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:55:49,479 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 17:55:49,479 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 17:55:49,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 17:55:49,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:55:49,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:55:49,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 17:55:49,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 17:55:49,479 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:55:49,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:55:49,480 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:49,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:55:49,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:55:49,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 17:55:49,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 17:55:49,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:55:49,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 17:55:49,481 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:49,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:49,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:55:49,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 17:55:49,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:49,483 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:49,483 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 17:55:49,483 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 17:55:49,483 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:55:49,483 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:49,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:55:49,483 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-13 17:55:49,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:55:49,483 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:55:49,483 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-02-13 17:55:49,483 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:55:49,483 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 17:55:49,483 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:55:49,483 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 17:55:49,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:55:49,483 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 17:55:49,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:55:49,483 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-13 17:55:49,484 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:55:49,584 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:55:49,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:55:49,596 DEBUG [Listener at localhost/35343] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 17:55:49,604 DEBUG [Listener at localhost/35343] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 17:55:49,612 DEBUG [Listener at localhost/35343] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 17:55:49,613 DEBUG [Listener at localhost/35343] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 17:55:49,638 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:55:49,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-02-13 17:55:49,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-13 17:55:49,639 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-13 17:55:49,639 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:55:49,640 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-13 17:55:49,640 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-13 17:55:49,640 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 17:55:49,640 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 17:55:49,641 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:49,641 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:55:49,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:55:49,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:55:49,641 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:49,641 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:55:49,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 17:55:49,642 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 17:55:49,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:55:49,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 17:55:49,642 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-13 17:55:49,642 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-02-13 17:55:49,642 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-13 17:55:49,642 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-13 17:55:49,642 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:55:49,642 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-13 17:55:49,643 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1676310940745.226b4a6bd1e102bd425b4fe5fa7b9927. 2023-02-13 17:55:49,643 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1676310940745.0e77f96cde768bcde1fba587339782c6. 2023-02-13 17:55:49,643 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 17:55:49,643 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:55:49,643 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1676310940745.7ec577192744923b1bb4fd6145642689. 2023-02-13 17:55:49,643 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1676310940745.0e77f96cde768bcde1fba587339782c6. started... 2023-02-13 17:55:49,643 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1676310940745.226b4a6bd1e102bd425b4fe5fa7b9927. started... 2023-02-13 17:55:49,643 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1676310940745.7ec577192744923b1bb4fd6145642689. started... 2023-02-13 17:55:49,643 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 0e77f96cde768bcde1fba587339782c6 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-13 17:55:49,643 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 7ec577192744923b1bb4fd6145642689 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-13 17:55:49,643 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 226b4a6bd1e102bd425b4fe5fa7b9927 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-13 17:55:50,464 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/.tmp/family1/e223b450fa76402e9f321e695f707ac6 2023-02-13 17:55:50,465 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/.tmp/family1/c8ad51c2e3734dad93121fdf867f6ece 2023-02-13 17:55:50,466 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/.tmp/family1/4125de0afded411f9d28d4998d516bf5 2023-02-13 17:55:50,467 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e223b450fa76402e9f321e695f707ac6 2023-02-13 17:55:50,469 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c8ad51c2e3734dad93121fdf867f6ece 2023-02-13 17:55:50,469 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4125de0afded411f9d28d4998d516bf5 2023-02-13 17:55:50,479 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/.tmp/family2/5b205215032f49c5aff6908aa6a40c3c 2023-02-13 17:55:50,480 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/.tmp/family2/0c349f29abee4facab3ccba099cdf7c8 2023-02-13 17:55:50,482 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5b205215032f49c5aff6908aa6a40c3c 2023-02-13 17:55:50,483 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0c349f29abee4facab3ccba099cdf7c8 2023-02-13 17:55:50,483 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/.tmp/family1/c8ad51c2e3734dad93121fdf867f6ece as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family1/c8ad51c2e3734dad93121fdf867f6ece 2023-02-13 17:55:50,484 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/.tmp/family1/4125de0afded411f9d28d4998d516bf5 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family1/4125de0afded411f9d28d4998d516bf5 2023-02-13 17:55:50,486 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c8ad51c2e3734dad93121fdf867f6ece 2023-02-13 17:55:50,486 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family1/c8ad51c2e3734dad93121fdf867f6ece, entries=3, sequenceid=23, filesize=5.0 K 2023-02-13 17:55:50,487 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4125de0afded411f9d28d4998d516bf5 2023-02-13 17:55:50,487 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family1/4125de0afded411f9d28d4998d516bf5, entries=3, sequenceid=23, filesize=5.0 K 2023-02-13 17:55:50,487 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/.tmp/family2/5b205215032f49c5aff6908aa6a40c3c as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family2/5b205215032f49c5aff6908aa6a40c3c 2023-02-13 17:55:50,487 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/.tmp/family2/0c349f29abee4facab3ccba099cdf7c8 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family2/0c349f29abee4facab3ccba099cdf7c8 2023-02-13 17:55:50,491 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5b205215032f49c5aff6908aa6a40c3c 2023-02-13 17:55:50,491 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family2/5b205215032f49c5aff6908aa6a40c3c, entries=1, sequenceid=23, filesize=5.0 K 2023-02-13 17:55:50,491 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0c349f29abee4facab3ccba099cdf7c8 2023-02-13 17:55:50,491 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family2/0c349f29abee4facab3ccba099cdf7c8, entries=1, sequenceid=23, filesize=5.0 K 2023-02-13 17:55:50,491 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 7ec577192744923b1bb4fd6145642689 in 848ms, sequenceid=23, compaction requested=true 2023-02-13 17:55:50,492 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 7ec577192744923b1bb4fd6145642689: 2023-02-13 17:55:50,492 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1676310940745.7ec577192744923b1bb4fd6145642689. 2023-02-13 17:55:50,492 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 17:55:50,492 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 226b4a6bd1e102bd425b4fe5fa7b9927 in 849ms, sequenceid=23, compaction requested=true 2023-02-13 17:55:50,492 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 226b4a6bd1e102bd425b4fe5fa7b9927: 2023-02-13 17:55:50,492 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1676310940745.226b4a6bd1e102bd425b4fe5fa7b9927. 2023-02-13 17:55:50,492 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 17:55:51,279 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/.tmp/family2/0ad0f0e0257b4e69a8fea1d44847db16 2023-02-13 17:55:51,283 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0ad0f0e0257b4e69a8fea1d44847db16 2023-02-13 17:55:51,284 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/.tmp/family1/e223b450fa76402e9f321e695f707ac6 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family1/e223b450fa76402e9f321e695f707ac6 2023-02-13 17:55:51,288 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e223b450fa76402e9f321e695f707ac6 2023-02-13 17:55:51,288 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family1/e223b450fa76402e9f321e695f707ac6, entries=3, sequenceid=23, filesize=5.0 K 2023-02-13 17:55:51,289 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/.tmp/family2/0ad0f0e0257b4e69a8fea1d44847db16 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family2/0ad0f0e0257b4e69a8fea1d44847db16 2023-02-13 17:55:51,292 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0ad0f0e0257b4e69a8fea1d44847db16 2023-02-13 17:55:51,292 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family2/0ad0f0e0257b4e69a8fea1d44847db16, entries=1, sequenceid=23, filesize=5.0 K 2023-02-13 17:55:51,293 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 0e77f96cde768bcde1fba587339782c6 in 1650ms, sequenceid=23, compaction requested=true 2023-02-13 17:55:51,293 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 0e77f96cde768bcde1fba587339782c6: 2023-02-13 17:55:51,293 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1676310940745.0e77f96cde768bcde1fba587339782c6. 2023-02-13 17:55:51,293 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 17:55:51,293 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 17:55:51,293 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:51,293 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-13 17:55:51,293 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-13 17:55:51,295 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:51,295 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 17:55:51,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:51,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:55:51,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:55:51,295 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 17:55:51,295 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:55:51,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:55:51,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:55:51,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 17:55:51,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:51,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:55:51,296 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-13 17:55:51,296 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4523dfe8[Count = 0] remaining members to acquire global barrier 2023-02-13 17:55:51,296 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-13 17:55:51,296 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 17:55:51,297 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 17:55:51,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 17:55:51,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 17:55:51,297 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-13 17:55:51,297 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:51,298 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:55:51,297 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-13 17:55:51,298 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:55:51,299 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:51,299 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-13 17:55:51,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:51,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:55:51,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:55:51,299 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:55:51,299 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-13 17:55:51,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:55:51,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:55:51,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 17:55:51,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:51,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:55:51,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 17:55:51,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:51,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:55:51,301 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-13 17:55:51,301 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-13 17:55:51,301 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:55:51,301 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:55:51,301 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-13 17:55:51,301 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:55:51,306 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 17:55:51,306 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 17:55:51,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 17:55:51,306 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:55:51,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 17:55:51,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:55:51,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:55:51,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 17:55:51,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:55:51,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:55:51,307 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:51,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:55:51,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 17:55:51,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 17:55:51,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:55:51,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 17:55:51,308 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:51,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:51,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:55:51,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 17:55:51,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:51,309 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:51,309 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 17:55:51,309 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 17:55:51,309 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:51,309 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 17:55:51,310 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 17:55:51,310 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 17:55:51,310 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:55:51,310 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-02-13 17:55:51,310 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-13 17:55:51,310 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:55:51,310 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:55:51,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:55:51,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:55:51,310 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:55:51,310 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-13 17:55:51,310 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:55:51,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:55:51,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:55:51,410 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:55:51,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:55:51,411 DEBUG [Listener at localhost/35343] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 17:55:51,412 DEBUG [Listener at localhost/35343] regionserver.HStore(1912): 226b4a6bd1e102bd425b4fe5fa7b9927/family1 is initiating major compaction (all files) 2023-02-13 17:55:51,412 INFO [Listener at localhost/35343] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 17:55:51,412 INFO [Listener at localhost/35343] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 17:55:51,412 INFO [Listener at localhost/35343] regionserver.HRegion(2258): Starting compaction of 226b4a6bd1e102bd425b4fe5fa7b9927/family1 in ns:testMinorCompaction,1,1676310940745.226b4a6bd1e102bd425b4fe5fa7b9927. 2023-02-13 17:55:51,412 INFO [Listener at localhost/35343] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family1/17fa94c5e75a409bbbf673ead018e4b7, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family1/9dc23ece6fa14dd0baadd4d110db0d6b, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family1/3c7bacf5237b4039b87295d634fc8054, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family1/030870c2c0c14456b44be564d96d3d7c, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family1/4125de0afded411f9d28d4998d516bf5] into tmpdir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/.tmp, totalSize=26.6 K 2023-02-13 17:55:51,413 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting 17fa94c5e75a409bbbf673ead018e4b7, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676310942859 2023-02-13 17:55:51,413 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting 9dc23ece6fa14dd0baadd4d110db0d6b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676310944639 2023-02-13 17:55:51,413 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting 3c7bacf5237b4039b87295d634fc8054, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676310946435 2023-02-13 17:55:51,414 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting 030870c2c0c14456b44be564d96d3d7c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676310948209 2023-02-13 17:55:51,414 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting 4125de0afded411f9d28d4998d516bf5, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-13 17:55:51,421 INFO [Listener at localhost/35343] throttle.PressureAwareThroughputController(145): 226b4a6bd1e102bd425b4fe5fa7b9927#family1#compaction#150 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 17:55:51,829 INFO [Listener at localhost/35343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023021305041e58b26a4aa48a9a68c3c021b9f7_del 2023-02-13 17:55:51,829 INFO [Listener at localhost/35343] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021305041e58b26a4aa48a9a68c3c021b9f7_del to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023021305041e58b26a4aa48a9a68c3c021b9f7_del 2023-02-13 17:55:52,641 INFO [Listener at localhost/35343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8e02e9302bc543459017b6eab86fc2be 2023-02-13 17:55:52,642 DEBUG [Listener at localhost/35343] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/.tmp/family1/8e02e9302bc543459017b6eab86fc2be as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family1/8e02e9302bc543459017b6eab86fc2be 2023-02-13 17:55:52,645 INFO [Listener at localhost/35343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8e02e9302bc543459017b6eab86fc2be 2023-02-13 17:55:52,646 INFO [Listener at localhost/35343] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 226b4a6bd1e102bd425b4fe5fa7b9927/family1 of 226b4a6bd1e102bd425b4fe5fa7b9927 into 8e02e9302bc543459017b6eab86fc2be(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 17:55:52,646 DEBUG [Listener at localhost/35343] regionserver.HRegion(2288): Compaction status journal for 226b4a6bd1e102bd425b4fe5fa7b9927: 2023-02-13 17:55:52,646 DEBUG [Listener at localhost/35343] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 17:55:52,647 DEBUG [Listener at localhost/35343] regionserver.HStore(1912): 226b4a6bd1e102bd425b4fe5fa7b9927/family2 is initiating major compaction (all files) 2023-02-13 17:55:52,647 INFO [Listener at localhost/35343] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 17:55:52,647 INFO [Listener at localhost/35343] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 17:55:52,647 INFO [Listener at localhost/35343] regionserver.HRegion(2258): Starting compaction of 226b4a6bd1e102bd425b4fe5fa7b9927/family2 in ns:testMinorCompaction,1,1676310940745.226b4a6bd1e102bd425b4fe5fa7b9927. 2023-02-13 17:55:52,647 INFO [Listener at localhost/35343] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family2/f05e9a522aa54fc58d73499d426cf0da, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family2/4e77638cb65d42fb9f7e31a19fa20e33, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family2/a86f53c24e8748deb4d5c54bba853823, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family2/04337e39bb084893a46e42932f404744, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family2/0c349f29abee4facab3ccba099cdf7c8] into tmpdir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/.tmp, totalSize=25.3 K 2023-02-13 17:55:52,648 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting f05e9a522aa54fc58d73499d426cf0da, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676310942859 2023-02-13 17:55:52,648 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting 4e77638cb65d42fb9f7e31a19fa20e33, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676310944639 2023-02-13 17:55:52,648 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting a86f53c24e8748deb4d5c54bba853823, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676310946435 2023-02-13 17:55:52,649 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting 04337e39bb084893a46e42932f404744, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676310948209 2023-02-13 17:55:52,649 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting 0c349f29abee4facab3ccba099cdf7c8, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-13 17:55:52,656 INFO [Listener at localhost/35343] throttle.PressureAwareThroughputController(145): 226b4a6bd1e102bd425b4fe5fa7b9927#family2#compaction#151 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 17:55:52,737 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family1/17fa94c5e75a409bbbf673ead018e4b7, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family1/9dc23ece6fa14dd0baadd4d110db0d6b, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family1/3c7bacf5237b4039b87295d634fc8054, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family1/030870c2c0c14456b44be564d96d3d7c, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family1/4125de0afded411f9d28d4998d516bf5] to archive 2023-02-13 17:55:52,738 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:55:52,740 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family1/17fa94c5e75a409bbbf673ead018e4b7 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family1/17fa94c5e75a409bbbf673ead018e4b7 2023-02-13 17:55:52,741 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family1/9dc23ece6fa14dd0baadd4d110db0d6b to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family1/9dc23ece6fa14dd0baadd4d110db0d6b 2023-02-13 17:55:52,742 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family1/3c7bacf5237b4039b87295d634fc8054 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family1/3c7bacf5237b4039b87295d634fc8054 2023-02-13 17:55:52,743 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family1/030870c2c0c14456b44be564d96d3d7c to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family1/030870c2c0c14456b44be564d96d3d7c 2023-02-13 17:55:52,744 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family1/4125de0afded411f9d28d4998d516bf5 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family1/4125de0afded411f9d28d4998d516bf5 2023-02-13 17:55:53,065 INFO [Listener at localhost/35343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230213f35d8cf511fa431ea50e28cd624f397d_del 2023-02-13 17:55:53,065 INFO [Listener at localhost/35343] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213f35d8cf511fa431ea50e28cd624f397d_del to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230213f35d8cf511fa431ea50e28cd624f397d_del 2023-02-13 17:55:53,877 INFO [Listener at localhost/35343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8acf89bfad3b414b9141e2595fd82f5a 2023-02-13 17:55:53,878 DEBUG [Listener at localhost/35343] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/.tmp/family2/8acf89bfad3b414b9141e2595fd82f5a as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family2/8acf89bfad3b414b9141e2595fd82f5a 2023-02-13 17:55:53,881 INFO [Listener at localhost/35343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8acf89bfad3b414b9141e2595fd82f5a 2023-02-13 17:55:53,882 INFO [Listener at localhost/35343] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 226b4a6bd1e102bd425b4fe5fa7b9927/family2 of 226b4a6bd1e102bd425b4fe5fa7b9927 into 8acf89bfad3b414b9141e2595fd82f5a(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 17:55:53,882 DEBUG [Listener at localhost/35343] regionserver.HRegion(2288): Compaction status journal for 226b4a6bd1e102bd425b4fe5fa7b9927: 2023-02-13 17:55:53,882 DEBUG [Listener at localhost/35343] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 17:55:53,882 DEBUG [Listener at localhost/35343] regionserver.HStore(1912): 0e77f96cde768bcde1fba587339782c6/family1 is initiating major compaction (all files) 2023-02-13 17:55:53,882 INFO [Listener at localhost/35343] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 17:55:53,882 INFO [Listener at localhost/35343] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 17:55:53,883 INFO [Listener at localhost/35343] regionserver.HRegion(2258): Starting compaction of 0e77f96cde768bcde1fba587339782c6/family1 in ns:testMinorCompaction,,1676310940745.0e77f96cde768bcde1fba587339782c6. 2023-02-13 17:55:53,883 INFO [Listener at localhost/35343] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family1/ed7e2345afbd4f5ca54a03422acb785d, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family1/d31f14b450164c569ee386796b39608d, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family1/b4af81ddcf0e4713b0bcd371a232c8d6, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family1/baed9c63d14f409086687c06ba0e8a4a, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family1/e223b450fa76402e9f321e695f707ac6] into tmpdir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/.tmp, totalSize=26.6 K 2023-02-13 17:55:53,883 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting ed7e2345afbd4f5ca54a03422acb785d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676310942858 2023-02-13 17:55:53,884 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting d31f14b450164c569ee386796b39608d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676310944639 2023-02-13 17:55:53,884 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting b4af81ddcf0e4713b0bcd371a232c8d6, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676310946435 2023-02-13 17:55:53,884 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting baed9c63d14f409086687c06ba0e8a4a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676310948208 2023-02-13 17:55:53,885 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting e223b450fa76402e9f321e695f707ac6, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-13 17:55:53,892 INFO [Listener at localhost/35343] throttle.PressureAwareThroughputController(145): 0e77f96cde768bcde1fba587339782c6#family1#compaction#152 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 17:55:53,937 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family2/f05e9a522aa54fc58d73499d426cf0da, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family2/4e77638cb65d42fb9f7e31a19fa20e33, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family2/a86f53c24e8748deb4d5c54bba853823, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family2/04337e39bb084893a46e42932f404744, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family2/0c349f29abee4facab3ccba099cdf7c8] to archive 2023-02-13 17:55:53,938 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:55:53,939 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family2/f05e9a522aa54fc58d73499d426cf0da to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family2/f05e9a522aa54fc58d73499d426cf0da 2023-02-13 17:55:53,940 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family2/4e77638cb65d42fb9f7e31a19fa20e33 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family2/4e77638cb65d42fb9f7e31a19fa20e33 2023-02-13 17:55:53,941 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family2/a86f53c24e8748deb4d5c54bba853823 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family2/a86f53c24e8748deb4d5c54bba853823 2023-02-13 17:55:53,942 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family2/04337e39bb084893a46e42932f404744 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family2/04337e39bb084893a46e42932f404744 2023-02-13 17:55:53,942 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family2/0c349f29abee4facab3ccba099cdf7c8 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family2/0c349f29abee4facab3ccba099cdf7c8 2023-02-13 17:55:54,301 INFO [Listener at localhost/35343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023021301a0d02f80404559a4024ddc5de0e2af_del 2023-02-13 17:55:54,301 INFO [Listener at localhost/35343] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021301a0d02f80404559a4024ddc5de0e2af_del to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023021301a0d02f80404559a4024ddc5de0e2af_del 2023-02-13 17:55:55,117 INFO [Listener at localhost/35343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a7bb319ef482438db3cefc9f3ef94abc 2023-02-13 17:55:55,117 DEBUG [Listener at localhost/35343] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/.tmp/family1/a7bb319ef482438db3cefc9f3ef94abc as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family1/a7bb319ef482438db3cefc9f3ef94abc 2023-02-13 17:55:55,121 INFO [Listener at localhost/35343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a7bb319ef482438db3cefc9f3ef94abc 2023-02-13 17:55:55,122 INFO [Listener at localhost/35343] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 0e77f96cde768bcde1fba587339782c6/family1 of 0e77f96cde768bcde1fba587339782c6 into a7bb319ef482438db3cefc9f3ef94abc(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 17:55:55,122 DEBUG [Listener at localhost/35343] regionserver.HRegion(2288): Compaction status journal for 0e77f96cde768bcde1fba587339782c6: 2023-02-13 17:55:55,122 DEBUG [Listener at localhost/35343] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 17:55:55,122 DEBUG [Listener at localhost/35343] regionserver.HStore(1912): 0e77f96cde768bcde1fba587339782c6/family2 is initiating major compaction (all files) 2023-02-13 17:55:55,122 INFO [Listener at localhost/35343] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 17:55:55,122 INFO [Listener at localhost/35343] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 17:55:55,122 INFO [Listener at localhost/35343] regionserver.HRegion(2258): Starting compaction of 0e77f96cde768bcde1fba587339782c6/family2 in ns:testMinorCompaction,,1676310940745.0e77f96cde768bcde1fba587339782c6. 2023-02-13 17:55:55,123 INFO [Listener at localhost/35343] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family2/cf785a703ff24442bfbd5b2e850fc8a6, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family2/a99195129c6e46c79b484bd4f388db84, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family2/0af1edb72f6c49b5b63de32639225e9c, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family2/6cd7735cc17d4db49c8fb93236b84156, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family2/0ad0f0e0257b4e69a8fea1d44847db16] into tmpdir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/.tmp, totalSize=25.3 K 2023-02-13 17:55:55,123 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting cf785a703ff24442bfbd5b2e850fc8a6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676310942858 2023-02-13 17:55:55,123 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting a99195129c6e46c79b484bd4f388db84, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676310944639 2023-02-13 17:55:55,123 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting 0af1edb72f6c49b5b63de32639225e9c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676310946435 2023-02-13 17:55:55,124 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting 6cd7735cc17d4db49c8fb93236b84156, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676310948208 2023-02-13 17:55:55,124 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting 0ad0f0e0257b4e69a8fea1d44847db16, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-13 17:55:55,133 INFO [Listener at localhost/35343] throttle.PressureAwareThroughputController(145): 0e77f96cde768bcde1fba587339782c6#family2#compaction#153 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 17:55:55,137 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family1/ed7e2345afbd4f5ca54a03422acb785d, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family1/d31f14b450164c569ee386796b39608d, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family1/b4af81ddcf0e4713b0bcd371a232c8d6, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family1/baed9c63d14f409086687c06ba0e8a4a, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family1/e223b450fa76402e9f321e695f707ac6] to archive 2023-02-13 17:55:55,138 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:55:55,139 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family1/ed7e2345afbd4f5ca54a03422acb785d to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family1/ed7e2345afbd4f5ca54a03422acb785d 2023-02-13 17:55:55,140 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family1/d31f14b450164c569ee386796b39608d to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family1/d31f14b450164c569ee386796b39608d 2023-02-13 17:55:55,141 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family1/b4af81ddcf0e4713b0bcd371a232c8d6 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family1/b4af81ddcf0e4713b0bcd371a232c8d6 2023-02-13 17:55:55,142 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family1/baed9c63d14f409086687c06ba0e8a4a to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family1/baed9c63d14f409086687c06ba0e8a4a 2023-02-13 17:55:55,143 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family1/e223b450fa76402e9f321e695f707ac6 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family1/e223b450fa76402e9f321e695f707ac6 2023-02-13 17:55:55,541 INFO [Listener at localhost/35343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023021360ce8c1994354162a9a35c658e4b5208_del 2023-02-13 17:55:55,542 INFO [Listener at localhost/35343] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021360ce8c1994354162a9a35c658e4b5208_del to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e2023021360ce8c1994354162a9a35c658e4b5208_del 2023-02-13 17:55:56,355 INFO [Listener at localhost/35343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 313563118ce54083bab7f64005e80bd7 2023-02-13 17:55:56,356 DEBUG [Listener at localhost/35343] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/.tmp/family2/313563118ce54083bab7f64005e80bd7 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family2/313563118ce54083bab7f64005e80bd7 2023-02-13 17:55:56,359 INFO [Listener at localhost/35343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 313563118ce54083bab7f64005e80bd7 2023-02-13 17:55:56,360 INFO [Listener at localhost/35343] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 0e77f96cde768bcde1fba587339782c6/family2 of 0e77f96cde768bcde1fba587339782c6 into 313563118ce54083bab7f64005e80bd7(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 17:55:56,360 DEBUG [Listener at localhost/35343] regionserver.HRegion(2288): Compaction status journal for 0e77f96cde768bcde1fba587339782c6: 2023-02-13 17:55:56,360 DEBUG [Listener at localhost/35343] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 17:55:56,360 DEBUG [Listener at localhost/35343] regionserver.HStore(1912): 7ec577192744923b1bb4fd6145642689/family1 is initiating major compaction (all files) 2023-02-13 17:55:56,360 INFO [Listener at localhost/35343] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 17:55:56,360 INFO [Listener at localhost/35343] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 17:55:56,360 INFO [Listener at localhost/35343] regionserver.HRegion(2258): Starting compaction of 7ec577192744923b1bb4fd6145642689/family1 in ns:testMinorCompaction,2,1676310940745.7ec577192744923b1bb4fd6145642689. 2023-02-13 17:55:56,360 INFO [Listener at localhost/35343] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family1/1eafba220f60459ea4d67f22915d2d18, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family1/c009fe17409b493e94563c6415ac9b3d, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family1/a77c811d355e42889f7360d53224e782, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family1/8a2ab61833b847059309f0326abd18df, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family1/c8ad51c2e3734dad93121fdf867f6ece] into tmpdir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/.tmp, totalSize=26.6 K 2023-02-13 17:55:56,361 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting 1eafba220f60459ea4d67f22915d2d18, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676310942859 2023-02-13 17:55:56,361 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting c009fe17409b493e94563c6415ac9b3d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676310944639 2023-02-13 17:55:56,361 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting a77c811d355e42889f7360d53224e782, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676310946436 2023-02-13 17:55:56,361 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting 8a2ab61833b847059309f0326abd18df, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676310948209 2023-02-13 17:55:56,361 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting c8ad51c2e3734dad93121fdf867f6ece, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-13 17:55:56,370 INFO [Listener at localhost/35343] throttle.PressureAwareThroughputController(145): 7ec577192744923b1bb4fd6145642689#family1#compaction#154 average throughput is 0.55 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 17:55:56,438 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family2/cf785a703ff24442bfbd5b2e850fc8a6, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family2/a99195129c6e46c79b484bd4f388db84, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family2/0af1edb72f6c49b5b63de32639225e9c, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family2/6cd7735cc17d4db49c8fb93236b84156, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family2/0ad0f0e0257b4e69a8fea1d44847db16] to archive 2023-02-13 17:55:56,439 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:55:56,440 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family2/cf785a703ff24442bfbd5b2e850fc8a6 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family2/cf785a703ff24442bfbd5b2e850fc8a6 2023-02-13 17:55:56,442 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family2/a99195129c6e46c79b484bd4f388db84 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family2/a99195129c6e46c79b484bd4f388db84 2023-02-13 17:55:56,443 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family2/0af1edb72f6c49b5b63de32639225e9c to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family2/0af1edb72f6c49b5b63de32639225e9c 2023-02-13 17:55:56,444 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family2/6cd7735cc17d4db49c8fb93236b84156 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family2/6cd7735cc17d4db49c8fb93236b84156 2023-02-13 17:55:56,445 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family2/0ad0f0e0257b4e69a8fea1d44847db16 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family2/0ad0f0e0257b4e69a8fea1d44847db16 2023-02-13 17:55:56,781 INFO [Listener at localhost/35343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202302131abdce72ca5c4a13abb4c6f506d64a7d_del 2023-02-13 17:55:56,781 INFO [Listener at localhost/35343] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302131abdce72ca5c4a13abb4c6f506d64a7d_del to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202302131abdce72ca5c4a13abb4c6f506d64a7d_del 2023-02-13 17:55:56,797 INFO [Listener at localhost/35343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2767e28ded5f4980ac9c570a50911211 2023-02-13 17:55:56,798 DEBUG [Listener at localhost/35343] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/.tmp/family1/2767e28ded5f4980ac9c570a50911211 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family1/2767e28ded5f4980ac9c570a50911211 2023-02-13 17:55:56,802 INFO [Listener at localhost/35343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2767e28ded5f4980ac9c570a50911211 2023-02-13 17:55:56,803 INFO [Listener at localhost/35343] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 7ec577192744923b1bb4fd6145642689/family1 of 7ec577192744923b1bb4fd6145642689 into 2767e28ded5f4980ac9c570a50911211(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 17:55:56,803 DEBUG [Listener at localhost/35343] regionserver.HRegion(2288): Compaction status journal for 7ec577192744923b1bb4fd6145642689: 2023-02-13 17:55:56,803 DEBUG [Listener at localhost/35343] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 17:55:56,803 DEBUG [Listener at localhost/35343] regionserver.HStore(1912): 7ec577192744923b1bb4fd6145642689/family2 is initiating major compaction (all files) 2023-02-13 17:55:56,803 INFO [Listener at localhost/35343] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 17:55:56,803 INFO [Listener at localhost/35343] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 17:55:56,803 INFO [Listener at localhost/35343] regionserver.HRegion(2258): Starting compaction of 7ec577192744923b1bb4fd6145642689/family2 in ns:testMinorCompaction,2,1676310940745.7ec577192744923b1bb4fd6145642689. 2023-02-13 17:55:56,803 INFO [Listener at localhost/35343] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family2/9eed95bdbba34429b0ffe8ac98a8d428, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family2/aef9e734e4f4465a83b91bd8bbf12513, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family2/30c658a6b0b143ba8b93456e7f89f439, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family2/c8c96865ae594556aac0383125214cea, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family2/5b205215032f49c5aff6908aa6a40c3c] into tmpdir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/.tmp, totalSize=25.3 K 2023-02-13 17:55:56,804 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting 9eed95bdbba34429b0ffe8ac98a8d428, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676310942859 2023-02-13 17:55:56,804 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting aef9e734e4f4465a83b91bd8bbf12513, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676310944639 2023-02-13 17:55:56,805 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting 30c658a6b0b143ba8b93456e7f89f439, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676310946436 2023-02-13 17:55:56,805 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting c8c96865ae594556aac0383125214cea, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676310948209 2023-02-13 17:55:56,805 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting 5b205215032f49c5aff6908aa6a40c3c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-13 17:55:56,814 INFO [Listener at localhost/35343] throttle.PressureAwareThroughputController(145): 7ec577192744923b1bb4fd6145642689#family2#compaction#155 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 17:55:56,838 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family1/1eafba220f60459ea4d67f22915d2d18, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family1/c009fe17409b493e94563c6415ac9b3d, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family1/a77c811d355e42889f7360d53224e782, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family1/8a2ab61833b847059309f0326abd18df, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family1/c8ad51c2e3734dad93121fdf867f6ece] to archive 2023-02-13 17:55:56,839 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:55:56,841 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family1/1eafba220f60459ea4d67f22915d2d18 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family1/1eafba220f60459ea4d67f22915d2d18 2023-02-13 17:55:56,841 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family1/c009fe17409b493e94563c6415ac9b3d to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family1/c009fe17409b493e94563c6415ac9b3d 2023-02-13 17:55:56,842 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family1/a77c811d355e42889f7360d53224e782 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family1/a77c811d355e42889f7360d53224e782 2023-02-13 17:55:56,843 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family1/8a2ab61833b847059309f0326abd18df to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family1/8a2ab61833b847059309f0326abd18df 2023-02-13 17:55:56,844 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family1/c8ad51c2e3734dad93121fdf867f6ece to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family1/c8ad51c2e3734dad93121fdf867f6ece 2023-02-13 17:55:57,222 INFO [Listener at localhost/35343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230213f4036daf75b2495ea11703087100afbc_del 2023-02-13 17:55:57,222 INFO [Listener at localhost/35343] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213f4036daf75b2495ea11703087100afbc_del to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230213f4036daf75b2495ea11703087100afbc_del 2023-02-13 17:55:57,639 INFO [Listener at localhost/35343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 98f447b3d8c243df9fdb0c2e53d3f011 2023-02-13 17:55:57,639 DEBUG [Listener at localhost/35343] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/.tmp/family2/98f447b3d8c243df9fdb0c2e53d3f011 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family2/98f447b3d8c243df9fdb0c2e53d3f011 2023-02-13 17:55:57,646 INFO [Listener at localhost/35343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 98f447b3d8c243df9fdb0c2e53d3f011 2023-02-13 17:55:57,647 INFO [Listener at localhost/35343] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 7ec577192744923b1bb4fd6145642689/family2 of 7ec577192744923b1bb4fd6145642689 into 98f447b3d8c243df9fdb0c2e53d3f011(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 17:55:57,647 DEBUG [Listener at localhost/35343] regionserver.HRegion(2288): Compaction status journal for 7ec577192744923b1bb4fd6145642689: 2023-02-13 17:55:57,650 DEBUG [Listener at localhost/35343] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 17:55:57,653 DEBUG [Listener at localhost/35343] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 17:55:57,655 DEBUG [Listener at localhost/35343] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 17:55:57,656 DEBUG [Listener at localhost/35343] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 17:55:57,661 INFO [Listener at localhost/35343] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-13 17:55:57,673 INFO [Listener at localhost/35343] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 3 del files, 3 selected files, and 0 irrelevant files table 'ns:testMinorCompaction' and column 'family1' 2023-02-13 17:55:57,675 INFO [Listener at localhost/35343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023021301a0d02f80404559a4024ddc5de0e2af_del 2023-02-13 17:55:57,677 INFO [Listener at localhost/35343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023021305041e58b26a4aa48a9a68c3c021b9f7_del 2023-02-13 17:55:57,680 INFO [Listener at localhost/35343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202302131abdce72ca5c4a13abb4c6f506d64a7d_del 2023-02-13 17:55:57,680 INFO [Listener at localhost/35343] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='ns:testMinorCompaction' column='family1' 2023-02-13 17:55:57,680 DEBUG [Listener at localhost/35343] zookeeper.ReadOnlyZKClient(139): Connect 0x4862b45c to 127.0.0.1:64825 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 17:55:57,684 DEBUG [Listener at localhost/35343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@361f4fd2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 17:55:57,685 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230213 for table='ns:testMinorCompaction' and column='family1' 2023-02-13 17:55:57,685 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230213 for table='ns:testMinorCompaction' and column='family1' 2023-02-13 17:55:57,685 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230213 for table='ns:testMinorCompaction' and column='family1' 2023-02-13 17:55:57,737 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family2/9eed95bdbba34429b0ffe8ac98a8d428, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family2/aef9e734e4f4465a83b91bd8bbf12513, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family2/30c658a6b0b143ba8b93456e7f89f439, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family2/c8c96865ae594556aac0383125214cea, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family2/5b205215032f49c5aff6908aa6a40c3c] to archive 2023-02-13 17:55:57,738 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:55:57,739 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family2/9eed95bdbba34429b0ffe8ac98a8d428 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family2/9eed95bdbba34429b0ffe8ac98a8d428 2023-02-13 17:55:57,740 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family2/aef9e734e4f4465a83b91bd8bbf12513 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family2/aef9e734e4f4465a83b91bd8bbf12513 2023-02-13 17:55:57,741 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family2/30c658a6b0b143ba8b93456e7f89f439 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family2/30c658a6b0b143ba8b93456e7f89f439 2023-02-13 17:55:57,741 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family2/c8c96865ae594556aac0383125214cea to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family2/c8c96865ae594556aac0383125214cea 2023-02-13 17:55:57,742 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family2/5b205215032f49c5aff6908aa6a40c3c to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family2/5b205215032f49c5aff6908aa6a40c3c 2023-02-13 17:55:58,115 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213bdc09ba8b9fc4f5391b82344c9a96653 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230213bdc09ba8b9fc4f5391b82344c9a96653 2023-02-13 17:55:58,116 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230213 table='ns:testMinorCompaction' column='family1' 2023-02-13 17:55:58,128 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 17:55:58,131 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37598, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 17:55:58,137 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 17:55:58,140 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40862, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 17:55:58,154 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230213/family1/940fabb2fd3e4f998a2813e4facb31b7 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x01] 2023-02-13 17:55:58,155 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,,1676310940745.0e77f96cde768bcde1fba587339782c6., hostname=jenkins-hbase4.apache.org,38881,1676310818035, seqNum=2 for row with hfile group [{family1,hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230213/family1/940fabb2fd3e4f998a2813e4facb31b7}] 2023-02-13 17:55:58,163 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(763): Validating hfile at hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230213/family1/940fabb2fd3e4f998a2813e4facb31b7 for inclusion in 0e77f96cde768bcde1fba587339782c6/family1 2023-02-13 17:55:58,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x01 2023-02-13 17:55:58,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(777): Region bounds: first= last=1 2023-02-13 17:55:58,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegion(2445): Flush status journal for 0e77f96cde768bcde1fba587339782c6: 2023-02-13 17:55:58,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230213/family1/940fabb2fd3e4f998a2813e4facb31b7 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__ns_testMinorCompaction__59iaeqqemisc255vf45jv44ofk3qls5di5qhuei6eutnhhdds6eo1el8fln5g6jn/family1/940fabb2fd3e4f998a2813e4facb31b7 2023-02-13 17:55:58,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__ns_testMinorCompaction__59iaeqqemisc255vf45jv44ofk3qls5di5qhuei6eutnhhdds6eo1el8fln5g6jn/family1/940fabb2fd3e4f998a2813e4facb31b7 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family1/4dadbc95669c4c5faaace0e6a41c22f7_SeqId_28_ 2023-02-13 17:55:58,172 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(849): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__ns_testMinorCompaction__59iaeqqemisc255vf45jv44ofk3qls5di5qhuei6eutnhhdds6eo1el8fln5g6jn/family1/940fabb2fd3e4f998a2813e4facb31b7 into 0e77f96cde768bcde1fba587339782c6/family1 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family1/4dadbc95669c4c5faaace0e6a41c22f7_SeqId_28_ - updating store file list. 2023-02-13 17:55:58,174 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(882): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family1/4dadbc95669c4c5faaace0e6a41c22f7_SeqId_28_ into 0e77f96cde768bcde1fba587339782c6/family1 2023-02-13 17:55:58,174 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HStore(855): Successfully loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__ns_testMinorCompaction__59iaeqqemisc255vf45jv44ofk3qls5di5qhuei6eutnhhdds6eo1el8fln5g6jn/family1/940fabb2fd3e4f998a2813e4facb31b7 into 0e77f96cde768bcde1fba587339782c6/family1 (new location: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/family1/4dadbc95669c4c5faaace0e6a41c22f7_SeqId_28_) 2023-02-13 17:55:58,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__ns_testMinorCompaction__59iaeqqemisc255vf45jv44ofk3qls5di5qhuei6eutnhhdds6eo1el8fln5g6jn/family1/940fabb2fd3e4f998a2813e4facb31b7 2023-02-13 17:55:58,177 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230213 table='ns:testMinorCompaction' column='family1' 2023-02-13 17:55:58,177 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:55:58,179 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230213c5e5e5573ce94ecdaefd6141167237b6 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230213c5e5e5573ce94ecdaefd6141167237b6 2023-02-13 17:55:58,179 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-02-13 17:55:58,179 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230213' 2023-02-13 17:55:58,179 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230213 for table='ns:testMinorCompaction' and column='family1' 2023-02-13 17:55:58,511 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213a6b64eca150a4f6cb5e2aed81bce1f94 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230213a6b64eca150a4f6cb5e2aed81bce1f94 2023-02-13 17:55:58,513 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230213 table='ns:testMinorCompaction' column='family1' 2023-02-13 17:55:58,522 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213e6f2c739ec8649c3b32babed27ca35c4 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230213e6f2c739ec8649c3b32babed27ca35c4 2023-02-13 17:55:58,522 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230213 table='ns:testMinorCompaction' column='family1' 2023-02-13 17:55:58,541 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230213/family1/d4c6be2212874088a76ecee10c84bdd7 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x01] 2023-02-13 17:55:58,542 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,2,1676310940745.7ec577192744923b1bb4fd6145642689., hostname=jenkins-hbase4.apache.org,38881,1676310818035, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230213/family1/d4c6be2212874088a76ecee10c84bdd7}] 2023-02-13 17:55:58,546 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(763): Validating hfile at hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230213/family1/d4c6be2212874088a76ecee10c84bdd7 for inclusion in 7ec577192744923b1bb4fd6145642689/family1 2023-02-13 17:55:58,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x01 2023-02-13 17:55:58,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-13 17:55:58,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HRegion(2445): Flush status journal for 7ec577192744923b1bb4fd6145642689: 2023-02-13 17:55:58,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230213/family1/d4c6be2212874088a76ecee10c84bdd7 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__ns_testMinorCompaction__oqjum0p3oc1qgienci1k7d7maq8igqdve75u2o8ke4433va5dd1dgseskb1ucr0n/family1/d4c6be2212874088a76ecee10c84bdd7 2023-02-13 17:55:58,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__ns_testMinorCompaction__oqjum0p3oc1qgienci1k7d7maq8igqdve75u2o8ke4433va5dd1dgseskb1ucr0n/family1/d4c6be2212874088a76ecee10c84bdd7 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family1/92bd059be5e44906b44ac08521654be8_SeqId_28_ 2023-02-13 17:55:58,552 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(849): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__ns_testMinorCompaction__oqjum0p3oc1qgienci1k7d7maq8igqdve75u2o8ke4433va5dd1dgseskb1ucr0n/family1/d4c6be2212874088a76ecee10c84bdd7 into 7ec577192744923b1bb4fd6145642689/family1 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family1/92bd059be5e44906b44ac08521654be8_SeqId_28_ - updating store file list. 2023-02-13 17:55:58,560 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(882): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family1/92bd059be5e44906b44ac08521654be8_SeqId_28_ into 7ec577192744923b1bb4fd6145642689/family1 2023-02-13 17:55:58,560 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(855): Successfully loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__ns_testMinorCompaction__oqjum0p3oc1qgienci1k7d7maq8igqdve75u2o8ke4433va5dd1dgseskb1ucr0n/family1/d4c6be2212874088a76ecee10c84bdd7 into 7ec577192744923b1bb4fd6145642689/family1 (new location: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/family1/92bd059be5e44906b44ac08521654be8_SeqId_28_) 2023-02-13 17:55:58,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__ns_testMinorCompaction__oqjum0p3oc1qgienci1k7d7maq8igqdve75u2o8ke4433va5dd1dgseskb1ucr0n/family1/d4c6be2212874088a76ecee10c84bdd7 2023-02-13 17:55:58,563 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230213/family1/180651e26f394c9c9cf427b3704e93ef first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x01] 2023-02-13 17:55:58,563 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230213 table='ns:testMinorCompaction' column='family1' 2023-02-13 17:55:58,565 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,1,1676310940745.226b4a6bd1e102bd425b4fe5fa7b9927., hostname=jenkins-hbase4.apache.org,38881,1676310818035, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230213/family1/180651e26f394c9c9cf427b3704e93ef}] 2023-02-13 17:55:58,565 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:55:58,566 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230213519d52fc2f1f4ed09688a5859ffefaf8 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230213519d52fc2f1f4ed09688a5859ffefaf8 2023-02-13 17:55:58,566 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-02-13 17:55:58,566 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230213' 2023-02-13 17:55:58,567 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230213 for table='ns:testMinorCompaction' and column='family1' 2023-02-13 17:55:58,567 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(763): Validating hfile at hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230213/family1/180651e26f394c9c9cf427b3704e93ef for inclusion in 226b4a6bd1e102bd425b4fe5fa7b9927/family1 2023-02-13 17:55:58,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x01 2023-02-13 17:55:58,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(777): Region bounds: first=1 last=2 2023-02-13 17:55:58,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HRegion(2445): Flush status journal for 226b4a6bd1e102bd425b4fe5fa7b9927: 2023-02-13 17:55:58,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230213/family1/180651e26f394c9c9cf427b3704e93ef to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__ns_testMinorCompaction__e250ts95e9iigr1ootdfg68fievgr73qh3mf65113is4u79gstcpnutb7t122alt/family1/180651e26f394c9c9cf427b3704e93ef 2023-02-13 17:55:58,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__ns_testMinorCompaction__e250ts95e9iigr1ootdfg68fievgr73qh3mf65113is4u79gstcpnutb7t122alt/family1/180651e26f394c9c9cf427b3704e93ef as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family1/cb046d1e5dba4507bfcdb702f6f23090_SeqId_28_ 2023-02-13 17:55:58,573 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(849): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__ns_testMinorCompaction__e250ts95e9iigr1ootdfg68fievgr73qh3mf65113is4u79gstcpnutb7t122alt/family1/180651e26f394c9c9cf427b3704e93ef into 226b4a6bd1e102bd425b4fe5fa7b9927/family1 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family1/cb046d1e5dba4507bfcdb702f6f23090_SeqId_28_ - updating store file list. 2023-02-13 17:55:58,576 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(882): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family1/cb046d1e5dba4507bfcdb702f6f23090_SeqId_28_ into 226b4a6bd1e102bd425b4fe5fa7b9927/family1 2023-02-13 17:55:58,576 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(855): Successfully loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__ns_testMinorCompaction__e250ts95e9iigr1ootdfg68fievgr73qh3mf65113is4u79gstcpnutb7t122alt/family1/180651e26f394c9c9cf427b3704e93ef into 226b4a6bd1e102bd425b4fe5fa7b9927/family1 (new location: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/family1/cb046d1e5dba4507bfcdb702f6f23090_SeqId_28_) 2023-02-13 17:55:58,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__ns_testMinorCompaction__e250ts95e9iigr1ootdfg68fievgr73qh3mf65113is4u79gstcpnutb7t122alt/family1/180651e26f394c9c9cf427b3704e93ef 2023-02-13 17:55:58,578 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230213 table='ns:testMinorCompaction' column='family1' 2023-02-13 17:55:58,579 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:55:58,580 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202302138390e7c0491c4190a41be5185813eff9 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202302138390e7c0491c4190a41be5185813eff9 2023-02-13 17:55:58,580 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-02-13 17:55:58,580 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230213' 2023-02-13 17:55:58,581 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230213 for table='ns:testMinorCompaction' and column='family1' 2023-02-13 17:55:58,581 INFO [Listener at localhost/35343] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='ns:testMinorCompaction' column='family1' 2023-02-13 17:55:58,584 DEBUG [Listener at localhost/35343] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 17:55:58,586 DEBUG [Listener at localhost/35343] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 17:55:58,589 DEBUG [Listener at localhost/35343] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 17:55:58,590 DEBUG [Listener at localhost/35343] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 17:55:58,611 INFO [Listener at localhost/35343] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompaction Thread=255 (was 285), OpenFileDescriptor=650 (was 761), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=138 (was 156), ProcessCount=168 (was 168), AvailableMemoryMB=874 (was 918) 2023-02-13 17:55:58,626 INFO [Listener at localhost/35343] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=255, OpenFileDescriptor=650, MaxFileDescriptor=60000, SystemLoadAverage=138, ProcessCount=168, AvailableMemoryMB=874 2023-02-13 17:55:58,628 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-13 17:55:58,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy 2023-02-13 17:55:58,630 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 17:55:58,630 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithMonthlyPolicy" procId is: 112 2023-02-13 17:55:58,631 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 17:55:58,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-13 17:55:58,632 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37 2023-02-13 17:55:58,632 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37 empty. 2023-02-13 17:55:58,633 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37 2023-02-13 17:55:58,633 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithMonthlyPolicy regions 2023-02-13 17:55:58,642 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-02-13 17:55:58,645 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7671): creating {ENCODED => 09a1ec58cf507f489c469b2ff2ea7e37, NAME => 'testMinorCompactionWithMonthlyPolicy,,1676310958628.09a1ec58cf507f489c469b2ff2ea7e37.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp 2023-02-13 17:55:58,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-13 17:55:58,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-13 17:55:59,050 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(865): Instantiated testMinorCompactionWithMonthlyPolicy,,1676310958628.09a1ec58cf507f489c469b2ff2ea7e37.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 17:55:59,050 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1603): Closing 09a1ec58cf507f489c469b2ff2ea7e37, disabling compactions & flushes 2023-02-13 17:55:59,050 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1625): Closing region testMinorCompactionWithMonthlyPolicy,,1676310958628.09a1ec58cf507f489c469b2ff2ea7e37. 2023-02-13 17:55:59,050 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1676310958628.09a1ec58cf507f489c469b2ff2ea7e37. 2023-02-13 17:55:59,050 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1713): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1676310958628.09a1ec58cf507f489c469b2ff2ea7e37. after waiting 0 ms 2023-02-13 17:55:59,050 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1723): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1676310958628.09a1ec58cf507f489c469b2ff2ea7e37. 2023-02-13 17:55:59,050 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1837): Closed testMinorCompactionWithMonthlyPolicy,,1676310958628.09a1ec58cf507f489c469b2ff2ea7e37. 2023-02-13 17:55:59,050 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1557): Region close journal for 09a1ec58cf507f489c469b2ff2ea7e37: Waiting for close lock at 1676310959050Disabling compacts and flushes for region at 1676310959050Disabling writes for close at 1676310959050Writing region close event to WAL at 1676310959050Closed at 1676310959050 2023-02-13 17:55:59,052 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 17:55:59,053 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithMonthlyPolicy,,1676310958628.09a1ec58cf507f489c469b2ff2ea7e37.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676310959053"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676310959053"}]},"ts":"1676310959053"} 2023-02-13 17:55:59,054 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 17:55:59,055 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 17:55:59,055 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676310959055"}]},"ts":"1676310959055"} 2023-02-13 17:55:59,056 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-02-13 17:55:59,059 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=09a1ec58cf507f489c469b2ff2ea7e37, ASSIGN}] 2023-02-13 17:55:59,060 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=09a1ec58cf507f489c469b2ff2ea7e37, ASSIGN 2023-02-13 17:55:59,061 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=09a1ec58cf507f489c469b2ff2ea7e37, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38881,1676310818035; forceNewPlan=false, retain=false 2023-02-13 17:55:59,212 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=09a1ec58cf507f489c469b2ff2ea7e37, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:59,212 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithMonthlyPolicy,,1676310958628.09a1ec58cf507f489c469b2ff2ea7e37.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676310959212"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676310959212"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676310959212"}]},"ts":"1676310959212"} 2023-02-13 17:55:59,213 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=114, ppid=113, state=RUNNABLE; OpenRegionProcedure 09a1ec58cf507f489c469b2ff2ea7e37, server=jenkins-hbase4.apache.org,38881,1676310818035}] 2023-02-13 17:55:59,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-13 17:55:59,368 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMinorCompactionWithMonthlyPolicy,,1676310958628.09a1ec58cf507f489c469b2ff2ea7e37. 2023-02-13 17:55:59,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 09a1ec58cf507f489c469b2ff2ea7e37, NAME => 'testMinorCompactionWithMonthlyPolicy,,1676310958628.09a1ec58cf507f489c469b2ff2ea7e37.', STARTKEY => '', ENDKEY => ''} 2023-02-13 17:55:59,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithMonthlyPolicy 09a1ec58cf507f489c469b2ff2ea7e37 2023-02-13 17:55:59,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMinorCompactionWithMonthlyPolicy,,1676310958628.09a1ec58cf507f489c469b2ff2ea7e37.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 17:55:59,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 09a1ec58cf507f489c469b2ff2ea7e37 2023-02-13 17:55:59,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 09a1ec58cf507f489c469b2ff2ea7e37 2023-02-13 17:55:59,370 INFO [StoreOpener-09a1ec58cf507f489c469b2ff2ea7e37-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 09a1ec58cf507f489c469b2ff2ea7e37 2023-02-13 17:55:59,371 DEBUG [StoreOpener-09a1ec58cf507f489c469b2ff2ea7e37-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1 2023-02-13 17:55:59,371 DEBUG [StoreOpener-09a1ec58cf507f489c469b2ff2ea7e37-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1 2023-02-13 17:55:59,371 INFO [StoreOpener-09a1ec58cf507f489c469b2ff2ea7e37-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 09a1ec58cf507f489c469b2ff2ea7e37 columnFamilyName family1 2023-02-13 17:55:59,373 INFO [StoreOpener-09a1ec58cf507f489c469b2ff2ea7e37-1] regionserver.HStore(310): Store=09a1ec58cf507f489c469b2ff2ea7e37/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 17:55:59,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37 2023-02-13 17:55:59,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37 2023-02-13 17:55:59,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 09a1ec58cf507f489c469b2ff2ea7e37 2023-02-13 17:55:59,378 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 17:55:59,378 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 09a1ec58cf507f489c469b2ff2ea7e37; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59864723, jitterRate=-0.10794611275196075}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 17:55:59,378 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 09a1ec58cf507f489c469b2ff2ea7e37: Running coprocessor pre-open hook at 1676310959369Writing region info on filesystem at 1676310959369Initializing all the Stores at 1676310959369Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1676310959370 (+1 ms)Cleaning up temporary data from old regions at 1676310959374 (+4 ms)Cleaning up detritus from prior splits at 1676310959374Running coprocessor post-open hooks at 1676310959378 (+4 ms)Region opened successfully at 1676310959378 2023-02-13 17:55:59,379 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMinorCompactionWithMonthlyPolicy,,1676310958628.09a1ec58cf507f489c469b2ff2ea7e37., pid=114, masterSystemTime=1676310959364 2023-02-13 17:55:59,380 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMinorCompactionWithMonthlyPolicy,,1676310958628.09a1ec58cf507f489c469b2ff2ea7e37. 2023-02-13 17:55:59,380 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMinorCompactionWithMonthlyPolicy,,1676310958628.09a1ec58cf507f489c469b2ff2ea7e37. 2023-02-13 17:55:59,381 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=09a1ec58cf507f489c469b2ff2ea7e37, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:59,381 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithMonthlyPolicy,,1676310958628.09a1ec58cf507f489c469b2ff2ea7e37.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676310959381"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676310959381"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676310959381"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676310959381"}]},"ts":"1676310959381"} 2023-02-13 17:55:59,383 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=114, resume processing ppid=113 2023-02-13 17:55:59,383 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=114, ppid=113, state=SUCCESS; OpenRegionProcedure 09a1ec58cf507f489c469b2ff2ea7e37, server=jenkins-hbase4.apache.org,38881,1676310818035 in 169 msec 2023-02-13 17:55:59,385 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=113, resume processing ppid=112 2023-02-13 17:55:59,385 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=113, ppid=112, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=09a1ec58cf507f489c469b2ff2ea7e37, ASSIGN in 324 msec 2023-02-13 17:55:59,385 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 17:55:59,385 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676310959385"}]},"ts":"1676310959385"} 2023-02-13 17:55:59,386 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-02-13 17:55:59,388 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 17:55:59,389 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy in 760 msec 2023-02-13 17:55:59,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-13 17:55:59,735 INFO [Listener at localhost/35343] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithMonthlyPolicy, procId: 112 completed 2023-02-13 17:55:59,753 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:55:59,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-13 17:55:59,756 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 17:55:59,756 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:55:59,756 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 17:55:59,756 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 17:55:59,756 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:55:59,756 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:55:59,757 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:59,757 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:55:59,757 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:55:59,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:55:59,758 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:55:59,758 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:55:59,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:55:59,758 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:55:59,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:55:59,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:55:59,759 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-13 17:55:59,760 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-13 17:55:59,760 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 17:55:59,760 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:55:59,760 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 17:55:59,760 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:55:59,760 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:55:59,760 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676310958628.09a1ec58cf507f489c469b2ff2ea7e37. 2023-02-13 17:55:59,760 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676310958628.09a1ec58cf507f489c469b2ff2ea7e37. started... 2023-02-13 17:55:59,761 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 09a1ec58cf507f489c469b2ff2ea7e37 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-13 17:56:00,182 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130eb6155d701084c188fb81f2002a98abc to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130eb6155d701084c188fb81f2002a98abc 2023-02-13 17:56:00,586 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/.tmp/family1/c1d7b82c8e7e40be992f2815a6a10862 2023-02-13 17:56:00,590 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/.tmp/family1/c1d7b82c8e7e40be992f2815a6a10862 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/c1d7b82c8e7e40be992f2815a6a10862 2023-02-13 17:56:00,593 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/c1d7b82c8e7e40be992f2815a6a10862, entries=1000, sequenceid=5, filesize=166.0 K 2023-02-13 17:56:00,594 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 09a1ec58cf507f489c469b2ff2ea7e37 in 833ms, sequenceid=5, compaction requested=false 2023-02-13 17:56:00,594 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 17:56:00,595 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 09a1ec58cf507f489c469b2ff2ea7e37: 2023-02-13 17:56:00,595 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676310958628.09a1ec58cf507f489c469b2ff2ea7e37. 2023-02-13 17:56:00,595 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:56:00,595 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:56:00,595 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:00,595 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 17:56:00,595 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-13 17:56:00,597 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:00,597 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:00,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:00,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:56:00,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:56:00,597 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:00,597 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:56:00,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:56:00,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:56:00,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:00,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:00,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:56:00,599 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 17:56:00,599 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2a9bb7b6[Count = 0] remaining members to acquire global barrier 2023-02-13 17:56:00,599 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 17:56:00,599 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:00,600 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:00,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:00,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:00,600 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 17:56:00,600 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-13 17:56:00,601 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:56:00,601 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:00,601 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:56:00,602 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:00,602 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 17:56:00,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:00,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:56:00,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:56:00,602 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:56:00,602 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-13 17:56:00,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:56:00,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:56:00,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:00,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:00,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:56:00,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:00,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:00,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:56:00,604 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 17:56:00,604 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-13 17:56:00,604 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:56:00,604 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:56:00,604 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:00,604 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:56:00,605 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:00,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:00,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:56:00,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:56:00,606 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:00,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:00,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:00,606 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:56:00,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:56:00,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:56:00,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:56:00,606 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:00,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:00,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:00,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:56:00,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:00,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:00,607 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:00,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:56:00,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:00,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:00,609 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:00,609 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:56:00,609 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:00,609 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:56:00,609 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 17:56:00,609 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:56:00,609 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:00,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:56:00,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:56:00,609 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:56:00,610 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:00,610 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 17:56:00,610 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:56:00,610 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:00,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:56:00,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:56:00,610 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:00,610 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:00,710 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:56:00,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:56:00,714 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:56:00,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 17:56:00,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:00,716 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 17:56:00,716 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:56:00,716 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 17:56:00,716 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 17:56:00,716 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:00,716 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:00,718 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:56:00,718 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:00,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:56:00,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:56:00,719 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:00,719 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:56:00,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:00,719 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:00,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:56:00,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:00,719 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:00,720 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 17:56:00,720 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:00,720 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 17:56:00,720 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:56:00,720 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 17:56:00,720 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:56:00,720 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:56:00,720 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676310958628.09a1ec58cf507f489c469b2ff2ea7e37. 2023-02-13 17:56:00,720 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676310958628.09a1ec58cf507f489c469b2ff2ea7e37. started... 2023-02-13 17:56:00,720 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 09a1ec58cf507f489c469b2ff2ea7e37 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-13 17:56:01,133 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128a1c7fb65fe6e428abcb55b474ee9b50e to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128a1c7fb65fe6e428abcb55b474ee9b50e 2023-02-13 17:56:01,538 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/.tmp/family1/5754cf4dc7234144935de79459f59b1f 2023-02-13 17:56:01,541 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/.tmp/family1/5754cf4dc7234144935de79459f59b1f as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/5754cf4dc7234144935de79459f59b1f 2023-02-13 17:56:01,545 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/5754cf4dc7234144935de79459f59b1f, entries=1, sequenceid=9, filesize=5.0 K 2023-02-13 17:56:01,545 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 09a1ec58cf507f489c469b2ff2ea7e37 in 825ms, sequenceid=9, compaction requested=false 2023-02-13 17:56:01,545 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 09a1ec58cf507f489c469b2ff2ea7e37: 2023-02-13 17:56:01,545 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676310958628.09a1ec58cf507f489c469b2ff2ea7e37. 2023-02-13 17:56:01,546 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:56:01,546 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:56:01,546 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:01,546 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 17:56:01,546 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-13 17:56:01,547 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:01,547 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:01,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:01,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:56:01,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:56:01,548 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:01,548 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:56:01,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:56:01,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:56:01,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:01,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:01,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:56:01,549 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 17:56:01,549 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@41198aa8[Count = 0] remaining members to acquire global barrier 2023-02-13 17:56:01,549 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 17:56:01,549 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:01,550 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:01,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:01,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:01,550 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 17:56:01,550 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-13 17:56:01,550 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:56:01,550 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:01,550 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:56:01,551 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 17:56:01,551 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:56:01,551 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:01,551 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-13 17:56:01,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:01,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:56:01,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:56:01,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:56:01,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:56:01,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:01,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:01,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:56:01,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:01,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:01,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:56:01,553 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 17:56:01,553 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-13 17:56:01,553 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:56:01,553 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:56:01,553 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:01,553 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:56:01,556 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:01,556 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:01,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:01,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:56:01,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:56:01,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:01,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:01,556 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:56:01,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:56:01,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:56:01,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:56:01,556 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:01,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:01,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:01,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:56:01,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:01,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:01,557 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:01,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:56:01,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:01,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:01,559 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:01,559 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:01,559 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:01,559 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:01,559 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 17:56:01,559 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:56:01,559 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:01,559 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:56:01,559 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:01,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:56:01,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:56:01,559 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:56:01,559 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:56:01,559 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:01,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:56:01,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:56:01,560 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 17:56:01,560 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:56:01,660 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:56:01,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:56:01,664 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:56:01,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 17:56:01,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:01,666 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 17:56:01,666 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:56:01,666 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 17:56:01,666 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 17:56:01,666 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:01,667 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:01,672 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:01,672 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:56:01,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:56:01,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:56:01,672 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:01,672 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:56:01,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:01,673 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:01,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:56:01,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:01,673 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:01,674 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 17:56:01,674 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:01,674 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 17:56:01,674 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:56:01,674 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 17:56:01,674 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:56:01,674 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:56:01,674 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676310958628.09a1ec58cf507f489c469b2ff2ea7e37. 2023-02-13 17:56:01,674 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676310958628.09a1ec58cf507f489c469b2ff2ea7e37. started... 2023-02-13 17:56:01,674 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 09a1ec58cf507f489c469b2ff2ea7e37 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 17:56:02,086 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201bd682a4d94594a7daa36ff5a604ace03 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201bd682a4d94594a7daa36ff5a604ace03 2023-02-13 17:56:02,492 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/.tmp/family1/7cb5681832be45fbb53117322eea09fb 2023-02-13 17:56:02,496 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/.tmp/family1/7cb5681832be45fbb53117322eea09fb as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/7cb5681832be45fbb53117322eea09fb 2023-02-13 17:56:02,499 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/7cb5681832be45fbb53117322eea09fb, entries=1, sequenceid=13, filesize=4.9 K 2023-02-13 17:56:02,500 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 09a1ec58cf507f489c469b2ff2ea7e37 in 826ms, sequenceid=13, compaction requested=true 2023-02-13 17:56:02,500 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 09a1ec58cf507f489c469b2ff2ea7e37: 2023-02-13 17:56:02,500 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676310958628.09a1ec58cf507f489c469b2ff2ea7e37. 2023-02-13 17:56:02,500 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:56:02,501 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:56:02,501 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:02,501 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 17:56:02,501 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-13 17:56:02,502 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:02,502 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:02,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:02,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:56:02,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:56:02,502 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:02,503 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:56:02,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:56:02,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:56:02,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:02,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:02,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:56:02,504 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 17:56:02,504 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5239b366[Count = 0] remaining members to acquire global barrier 2023-02-13 17:56:02,504 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 17:56:02,504 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:02,505 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:02,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:02,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:02,505 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 17:56:02,505 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-13 17:56:02,505 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:56:02,505 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:02,505 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:56:02,507 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:02,507 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 17:56:02,507 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:56:02,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:02,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:56:02,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:56:02,508 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-13 17:56:02,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:56:02,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:56:02,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:02,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:02,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:56:02,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:02,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:02,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:56:02,510 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 17:56:02,510 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-13 17:56:02,510 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:56:02,510 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:56:02,510 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:02,510 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:56:02,511 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:02,511 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:02,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:02,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:56:02,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:02,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:02,511 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:56:02,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:56:02,512 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:02,512 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:56:02,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:56:02,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:56:02,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:02,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:02,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:56:02,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:02,513 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:02,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:02,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:56:02,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:02,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:02,515 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:02,515 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:56:02,515 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:02,515 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:56:02,515 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 17:56:02,515 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:56:02,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:56:02,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:56:02,515 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:56:02,515 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:02,515 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:02,515 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:02,515 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 17:56:02,515 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:02,515 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:56:02,515 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 17:56:02,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:56:02,515 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:02,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:56:02,615 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:56:02,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:56:02,620 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:56:02,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 17:56:02,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:02,622 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 17:56:02,622 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:56:02,622 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 17:56:02,622 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 17:56:02,622 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:02,622 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:02,623 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:02,623 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:56:02,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:56:02,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:56:02,624 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:02,624 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:56:02,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:02,624 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:02,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:56:02,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:02,625 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:02,625 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 17:56:02,625 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:02,625 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 17:56:02,625 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:56:02,625 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 17:56:02,625 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:56:02,625 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:56:02,625 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676310958628.09a1ec58cf507f489c469b2ff2ea7e37. 2023-02-13 17:56:02,625 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676310958628.09a1ec58cf507f489c469b2ff2ea7e37. started... 2023-02-13 17:56:02,625 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 09a1ec58cf507f489c469b2ff2ea7e37 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 17:56:03,036 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512055825f4683af548488eccb1d3f49e91ee to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512055825f4683af548488eccb1d3f49e91ee 2023-02-13 17:56:03,441 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/.tmp/family1/787a0aa7342244598a5d2b2ed7b060fe 2023-02-13 17:56:03,445 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/.tmp/family1/787a0aa7342244598a5d2b2ed7b060fe as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/787a0aa7342244598a5d2b2ed7b060fe 2023-02-13 17:56:03,448 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/787a0aa7342244598a5d2b2ed7b060fe, entries=1, sequenceid=17, filesize=4.9 K 2023-02-13 17:56:03,449 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 09a1ec58cf507f489c469b2ff2ea7e37 in 823ms, sequenceid=17, compaction requested=true 2023-02-13 17:56:03,449 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 09a1ec58cf507f489c469b2ff2ea7e37: 2023-02-13 17:56:03,449 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676310958628.09a1ec58cf507f489c469b2ff2ea7e37. 2023-02-13 17:56:03,449 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:56:03,449 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:56:03,449 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:03,449 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 17:56:03,449 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-13 17:56:03,450 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:03,451 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:03,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:03,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:56:03,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:56:03,451 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:03,451 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:56:03,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:56:03,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:56:03,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:03,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:03,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:56:03,452 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 17:56:03,452 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9befa56[Count = 0] remaining members to acquire global barrier 2023-02-13 17:56:03,452 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 17:56:03,452 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:03,453 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:03,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:03,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:03,453 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 17:56:03,453 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-13 17:56:03,453 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:03,453 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:56:03,453 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:56:03,455 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:03,455 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 17:56:03,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:03,455 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:56:03,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:56:03,455 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-13 17:56:03,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:56:03,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:56:03,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:56:03,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:03,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:03,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:56:03,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:03,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:03,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:56:03,457 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 17:56:03,457 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-13 17:56:03,457 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:56:03,457 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:56:03,457 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:03,457 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:56:03,459 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:03,459 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:03,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:03,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:03,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:56:03,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:56:03,459 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:56:03,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:03,460 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:03,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:56:03,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:56:03,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:56:03,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:03,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:03,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:56:03,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:03,461 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:03,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:03,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:56:03,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:03,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:03,463 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:03,463 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:56:03,463 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:03,463 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:56:03,463 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 17:56:03,463 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 17:56:03,463 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:56:03,463 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:03,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:56:03,463 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:56:03,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:56:03,463 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:03,463 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:03,463 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 17:56:03,463 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:03,463 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:56:03,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:56:03,464 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:03,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:56:03,564 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:56:03,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:56:03,568 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:56:03,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 17:56:03,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:03,569 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 17:56:03,569 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:56:03,569 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 17:56:03,569 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 17:56:03,569 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:03,570 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:03,571 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:03,571 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:56:03,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:56:03,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:56:03,571 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:03,571 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:56:03,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:03,572 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:03,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:56:03,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:03,572 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:03,572 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 17:56:03,572 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:03,572 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 17:56:03,572 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:56:03,572 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 17:56:03,572 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:56:03,573 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:56:03,573 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676310958628.09a1ec58cf507f489c469b2ff2ea7e37. 2023-02-13 17:56:03,573 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676310958628.09a1ec58cf507f489c469b2ff2ea7e37. started... 2023-02-13 17:56:03,573 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 09a1ec58cf507f489c469b2ff2ea7e37 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 17:56:03,983 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228df1125a11d9e48b8a059c8e44292e23f to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228df1125a11d9e48b8a059c8e44292e23f 2023-02-13 17:56:04,397 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/.tmp/family1/7537eb22e5d847cb80cb511ad1da4793 2023-02-13 17:56:04,398 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 17:56:04,398 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4862b45c to 127.0.0.1:64825 2023-02-13 17:56:04,398 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 17:56:04,399 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 17:56:04,399 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0e13a0e8 to 127.0.0.1:64825 2023-02-13 17:56:04,399 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 17:56:04,399 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 17:56:04,399 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x78e7e520 to 127.0.0.1:64825 2023-02-13 17:56:04,399 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 17:56:04,403 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/.tmp/family1/7537eb22e5d847cb80cb511ad1da4793 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/7537eb22e5d847cb80cb511ad1da4793 2023-02-13 17:56:04,406 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/7537eb22e5d847cb80cb511ad1da4793, entries=1, sequenceid=21, filesize=4.9 K 2023-02-13 17:56:04,407 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 09a1ec58cf507f489c469b2ff2ea7e37 in 834ms, sequenceid=21, compaction requested=true 2023-02-13 17:56:04,407 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 09a1ec58cf507f489c469b2ff2ea7e37: 2023-02-13 17:56:04,407 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676310958628.09a1ec58cf507f489c469b2ff2ea7e37. 2023-02-13 17:56:04,407 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:56:04,407 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:56:04,407 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:04,407 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 17:56:04,407 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-13 17:56:04,409 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:04,409 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:04,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:04,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:56:04,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:56:04,409 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:04,409 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:56:04,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:56:04,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:56:04,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:04,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:04,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:56:04,410 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 17:56:04,410 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7e6fdad0[Count = 0] remaining members to acquire global barrier 2023-02-13 17:56:04,410 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 17:56:04,410 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:04,411 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:04,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:04,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:04,411 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 17:56:04,411 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-13 17:56:04,411 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:56:04,411 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:04,411 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:56:04,413 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:04,413 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 17:56:04,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:04,413 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:56:04,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:56:04,413 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-13 17:56:04,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:56:04,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:56:04,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:56:04,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:04,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:04,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:56:04,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:04,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:04,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:56:04,415 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 17:56:04,415 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-13 17:56:04,415 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:56:04,415 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:56:04,415 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:04,415 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:56:04,418 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:04,418 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:04,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:04,418 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:56:04,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:56:04,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:56:04,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:04,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:04,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:56:04,418 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:04,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:56:04,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:56:04,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:04,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:04,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:56:04,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:04,420 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:04,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:04,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:56:04,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:04,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:04,424 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:04,424 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:56:04,424 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:04,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:56:04,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:56:04,424 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 17:56:04,424 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:56:04,424 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:56:04,424 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:04,424 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:04,424 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:04,424 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:56:04,424 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 17:56:04,424 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 17:56:04,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:56:04,424 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:04,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:56:04,424 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:56:04,424 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:04,525 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:56:04,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:56:04,528 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:56:04,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 17:56:04,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:04,530 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 17:56:04,530 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:56:04,530 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 17:56:04,530 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 17:56:04,530 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:04,530 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:04,531 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:04,531 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:56:04,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:56:04,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:56:04,532 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:04,532 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:56:04,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:04,532 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:04,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:56:04,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:04,532 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:04,533 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 17:56:04,533 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:04,533 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 17:56:04,533 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:56:04,533 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 17:56:04,533 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:56:04,533 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:56:04,533 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676310958628.09a1ec58cf507f489c469b2ff2ea7e37. 2023-02-13 17:56:04,533 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676310958628.09a1ec58cf507f489c469b2ff2ea7e37. started... 2023-02-13 17:56:04,533 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 09a1ec58cf507f489c469b2ff2ea7e37 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 17:56:04,920 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 17:56:04,943 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512310c53f1c65eb64c589f95a92523098789 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512310c53f1c65eb64c589f95a92523098789 2023-02-13 17:56:05,349 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/.tmp/family1/1b24adfdbd214c288aa66d7db88311fd 2023-02-13 17:56:05,353 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/.tmp/family1/1b24adfdbd214c288aa66d7db88311fd as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/1b24adfdbd214c288aa66d7db88311fd 2023-02-13 17:56:05,356 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/1b24adfdbd214c288aa66d7db88311fd, entries=1, sequenceid=25, filesize=4.9 K 2023-02-13 17:56:05,357 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 09a1ec58cf507f489c469b2ff2ea7e37 in 824ms, sequenceid=25, compaction requested=true 2023-02-13 17:56:05,357 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 09a1ec58cf507f489c469b2ff2ea7e37: 2023-02-13 17:56:05,357 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676310958628.09a1ec58cf507f489c469b2ff2ea7e37. 2023-02-13 17:56:05,357 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:56:05,357 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:56:05,357 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:05,357 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 17:56:05,357 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-13 17:56:05,359 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:05,359 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:05,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:05,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:56:05,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:56:05,360 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:05,360 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:56:05,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:56:05,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:56:05,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:05,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:05,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:56:05,361 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 17:56:05,361 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@73ae437f[Count = 0] remaining members to acquire global barrier 2023-02-13 17:56:05,361 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 17:56:05,361 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:05,362 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:05,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:05,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:05,362 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 17:56:05,362 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-13 17:56:05,362 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:56:05,362 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:05,362 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:56:05,363 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 17:56:05,363 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:05,363 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:56:05,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:05,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:56:05,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:56:05,363 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-13 17:56:05,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:56:05,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:56:05,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:05,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:05,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:56:05,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:05,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:05,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:56:05,365 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 17:56:05,365 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-13 17:56:05,365 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:56:05,365 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:56:05,365 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:05,365 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:56:05,366 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:05,367 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:05,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:05,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:56:05,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:56:05,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:05,367 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:56:05,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:05,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:56:05,367 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:05,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:56:05,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:56:05,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:05,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:05,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:56:05,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:05,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:05,368 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:05,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:56:05,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:05,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:05,371 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:05,371 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:56:05,371 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:05,371 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:56:05,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:56:05,371 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 17:56:05,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:56:05,371 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:05,371 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:56:05,371 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:05,371 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:56:05,371 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:05,372 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:05,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:56:05,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:56:05,372 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:05,372 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 17:56:05,372 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:56:05,472 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:56:05,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:56:05,476 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:56:05,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 17:56:05,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:05,477 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 17:56:05,477 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:56:05,477 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 17:56:05,477 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 17:56:05,478 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:05,478 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:05,479 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:56:05,479 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:05,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:56:05,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:56:05,479 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:05,479 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:56:05,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:05,479 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:05,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:56:05,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:05,480 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:05,480 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 17:56:05,480 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:05,480 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 17:56:05,480 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:56:05,480 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 17:56:05,480 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:56:05,480 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:56:05,480 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676310958628.09a1ec58cf507f489c469b2ff2ea7e37. 2023-02-13 17:56:05,480 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676310958628.09a1ec58cf507f489c469b2ff2ea7e37. started... 2023-02-13 17:56:05,480 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 09a1ec58cf507f489c469b2ff2ea7e37 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 17:56:05,890 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101f47aa73480dc4fb1b79607cc7b76ae4a to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101f47aa73480dc4fb1b79607cc7b76ae4a 2023-02-13 17:56:05,894 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/.tmp/family1/ba4c5bf7d0cd41fd91f767e3434c0f10 2023-02-13 17:56:05,898 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/.tmp/family1/ba4c5bf7d0cd41fd91f767e3434c0f10 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/ba4c5bf7d0cd41fd91f767e3434c0f10 2023-02-13 17:56:05,901 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/ba4c5bf7d0cd41fd91f767e3434c0f10, entries=1, sequenceid=29, filesize=4.9 K 2023-02-13 17:56:05,902 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 09a1ec58cf507f489c469b2ff2ea7e37 in 422ms, sequenceid=29, compaction requested=true 2023-02-13 17:56:05,902 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 09a1ec58cf507f489c469b2ff2ea7e37: 2023-02-13 17:56:05,902 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676310958628.09a1ec58cf507f489c469b2ff2ea7e37. 2023-02-13 17:56:05,902 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:56:05,902 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:56:05,902 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:05,902 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 17:56:05,902 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-13 17:56:05,904 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:05,904 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:05,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:05,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:56:05,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:56:05,904 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:05,904 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:56:05,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:56:05,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:56:05,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:05,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:05,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:56:05,906 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 17:56:05,906 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6c936cef[Count = 0] remaining members to acquire global barrier 2023-02-13 17:56:05,906 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 17:56:05,906 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:05,907 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:05,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:05,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:05,907 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 17:56:05,907 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-13 17:56:05,907 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:56:05,908 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:05,908 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:56:05,910 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 17:56:05,910 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:56:05,910 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:05,910 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-13 17:56:05,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:05,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:56:05,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:56:05,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:56:05,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:56:05,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:05,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:05,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:56:05,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:05,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:05,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:56:05,912 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 17:56:05,912 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-13 17:56:05,913 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:56:05,913 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:56:05,913 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:05,913 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:56:05,914 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:05,914 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:05,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:05,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:05,914 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:56:05,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:05,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:56:05,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:56:05,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:56:05,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:56:05,915 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:05,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:56:05,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:05,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:05,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:56:05,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:05,916 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:05,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:05,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:56:05,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:05,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:05,919 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:05,919 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:56:05,919 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:05,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:56:05,919 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:56:05,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:56:05,919 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 17:56:05,919 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:56:05,919 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 17:56:05,919 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:56:05,919 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:05,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:56:05,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:56:05,919 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:05,919 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:05,919 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:05,919 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 17:56:05,919 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:05,919 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:56:06,020 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:56:06,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:56:06,024 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:56:06,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 17:56:06,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:06,026 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 17:56:06,026 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:56:06,026 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 17:56:06,026 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 17:56:06,026 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:06,026 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:06,028 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:56:06,028 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:06,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:56:06,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:56:06,028 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:06,028 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:56:06,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:06,028 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:06,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:56:06,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:06,029 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:06,029 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 17:56:06,029 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:06,029 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 17:56:06,029 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:56:06,029 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 17:56:06,029 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:56:06,030 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:56:06,030 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676310958628.09a1ec58cf507f489c469b2ff2ea7e37. 2023-02-13 17:56:06,030 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676310958628.09a1ec58cf507f489c469b2ff2ea7e37. started... 2023-02-13 17:56:06,030 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 09a1ec58cf507f489c469b2ff2ea7e37 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 17:56:06,041 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103afe6c61ee70b45319c6f8afa5a0044c3 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103afe6c61ee70b45319c6f8afa5a0044c3 2023-02-13 17:56:06,449 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/.tmp/family1/f1af0b1f5a7449d1822ec4ce7e3c676d 2023-02-13 17:56:06,453 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/.tmp/family1/f1af0b1f5a7449d1822ec4ce7e3c676d as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/f1af0b1f5a7449d1822ec4ce7e3c676d 2023-02-13 17:56:06,457 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/f1af0b1f5a7449d1822ec4ce7e3c676d, entries=1, sequenceid=33, filesize=4.9 K 2023-02-13 17:56:06,458 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 09a1ec58cf507f489c469b2ff2ea7e37 in 428ms, sequenceid=33, compaction requested=true 2023-02-13 17:56:06,458 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 09a1ec58cf507f489c469b2ff2ea7e37: 2023-02-13 17:56:06,458 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676310958628.09a1ec58cf507f489c469b2ff2ea7e37. 2023-02-13 17:56:06,458 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:56:06,458 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:56:06,458 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:06,458 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 17:56:06,458 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-13 17:56:06,465 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:06,465 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:06,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:06,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:56:06,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:56:06,465 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:06,465 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:56:06,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:56:06,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:56:06,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:06,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:06,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:56:06,467 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 17:56:06,468 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@12015761[Count = 0] remaining members to acquire global barrier 2023-02-13 17:56:06,468 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 17:56:06,468 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:06,469 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:06,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:06,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:06,469 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 17:56:06,469 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-13 17:56:06,469 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:56:06,470 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:06,470 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:56:06,471 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:06,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:06,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:56:06,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:56:06,471 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 17:56:06,472 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:56:06,472 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-13 17:56:06,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:56:06,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:56:06,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:06,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:06,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:56:06,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:06,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:06,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:56:06,475 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 17:56:06,475 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-13 17:56:06,475 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:56:06,475 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:56:06,475 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:06,475 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:56:06,481 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:06,481 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:56:06,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:06,481 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:06,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:06,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:06,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:56:06,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:56:06,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:56:06,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:56:06,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:56:06,482 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:06,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:06,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:06,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:56:06,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:06,483 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:06,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:06,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:56:06,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:06,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:06,485 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:06,485 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:06,485 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:06,485 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:56:06,485 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:06,485 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:56:06,485 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:56:06,485 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:56:06,485 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 17:56:06,485 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:56:06,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:56:06,485 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:06,485 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:06,485 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 17:56:06,485 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:06,485 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 17:56:06,486 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:56:06,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:56:06,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:56:06,586 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:56:06,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:56:06,591 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:56:06,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 17:56:06,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:06,597 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 17:56:06,597 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:56:06,597 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 17:56:06,597 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 17:56:06,598 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:06,598 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:06,599 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:06,599 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:56:06,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:56:06,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:56:06,599 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:06,599 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:56:06,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:06,600 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:06,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:56:06,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:06,600 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:06,604 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 17:56:06,604 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:06,604 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 17:56:06,604 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:56:06,604 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 17:56:06,604 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:56:06,604 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:56:06,604 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676310958628.09a1ec58cf507f489c469b2ff2ea7e37. 2023-02-13 17:56:06,604 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676310958628.09a1ec58cf507f489c469b2ff2ea7e37. started... 2023-02-13 17:56:06,605 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 09a1ec58cf507f489c469b2ff2ea7e37 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 17:56:07,023 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090719da5ead14d2495d9cb79cee3c0bffa8 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015090719da5ead14d2495d9cb79cee3c0bffa8 2023-02-13 17:56:07,427 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/.tmp/family1/e3bf010011a549048746f7243f52b908 2023-02-13 17:56:07,432 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/.tmp/family1/e3bf010011a549048746f7243f52b908 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/e3bf010011a549048746f7243f52b908 2023-02-13 17:56:07,441 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/e3bf010011a549048746f7243f52b908, entries=1, sequenceid=37, filesize=4.9 K 2023-02-13 17:56:07,441 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 09a1ec58cf507f489c469b2ff2ea7e37 in 837ms, sequenceid=37, compaction requested=true 2023-02-13 17:56:07,441 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 09a1ec58cf507f489c469b2ff2ea7e37: 2023-02-13 17:56:07,442 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676310958628.09a1ec58cf507f489c469b2ff2ea7e37. 2023-02-13 17:56:07,442 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:56:07,442 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:56:07,442 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:07,442 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 17:56:07,442 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-13 17:56:07,443 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:07,443 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:07,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:07,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:56:07,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:56:07,444 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:07,444 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:56:07,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:56:07,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:56:07,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:07,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:07,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:56:07,445 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 17:56:07,445 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1238b6ab[Count = 0] remaining members to acquire global barrier 2023-02-13 17:56:07,445 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 17:56:07,446 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:07,453 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:07,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:07,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:07,453 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 17:56:07,453 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-13 17:56:07,453 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:56:07,453 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:07,453 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:56:07,455 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:07,455 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 17:56:07,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:07,455 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:56:07,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:56:07,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:56:07,455 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-13 17:56:07,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:56:07,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:56:07,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:07,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:07,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:56:07,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:07,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:07,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:56:07,458 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 17:56:07,458 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-13 17:56:07,458 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:56:07,458 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:56:07,458 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:07,458 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:56:07,459 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:07,459 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:56:07,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:07,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:07,459 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:07,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:07,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:56:07,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:56:07,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:56:07,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:56:07,460 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:07,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:56:07,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:07,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:07,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:56:07,461 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:07,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:07,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:07,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:56:07,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:07,464 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:56:07,464 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:56:07,464 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:07,464 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:07,464 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 17:56:07,464 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:56:07,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:56:07,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:56:07,464 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:07,464 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:07,464 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:07,464 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:07,464 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:07,464 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:56:07,464 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 17:56:07,465 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 17:56:07,465 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:56:07,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:56:07,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:56:07,565 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:56:07,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:56:07,570 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:56:07,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 17:56:07,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:07,580 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 17:56:07,580 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:56:07,580 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 17:56:07,580 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 17:56:07,581 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:07,581 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:07,583 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:07,583 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:56:07,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:56:07,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:56:07,583 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:07,583 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:56:07,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:07,584 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:07,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:56:07,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:07,584 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:07,584 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 17:56:07,584 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:07,585 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 17:56:07,585 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:56:07,585 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 17:56:07,585 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 17:56:07,585 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:56:07,585 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676310958628.09a1ec58cf507f489c469b2ff2ea7e37. 2023-02-13 17:56:07,585 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676310958628.09a1ec58cf507f489c469b2ff2ea7e37. started... 2023-02-13 17:56:07,585 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 09a1ec58cf507f489c469b2ff2ea7e37 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 17:56:07,995 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120e97f39d35bca435385eaafdc28c783fa to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120e97f39d35bca435385eaafdc28c783fa 2023-02-13 17:56:08,400 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/.tmp/family1/d18dd14724094c3796edebc081ed55d8 2023-02-13 17:56:08,404 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/.tmp/family1/d18dd14724094c3796edebc081ed55d8 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/d18dd14724094c3796edebc081ed55d8 2023-02-13 17:56:08,407 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/d18dd14724094c3796edebc081ed55d8, entries=1, sequenceid=41, filesize=4.9 K 2023-02-13 17:56:08,407 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 09a1ec58cf507f489c469b2ff2ea7e37 in 822ms, sequenceid=41, compaction requested=true 2023-02-13 17:56:08,407 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 09a1ec58cf507f489c469b2ff2ea7e37: 2023-02-13 17:56:08,408 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676310958628.09a1ec58cf507f489c469b2ff2ea7e37. 2023-02-13 17:56:08,408 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 17:56:08,408 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 17:56:08,408 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:08,408 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 17:56:08,408 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-13 17:56:08,409 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:08,409 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:08,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:08,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:56:08,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:56:08,410 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:08,410 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:56:08,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:56:08,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:56:08,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:08,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:08,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:56:08,411 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 17:56:08,411 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@138caa28[Count = 0] remaining members to acquire global barrier 2023-02-13 17:56:08,411 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 17:56:08,411 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:08,412 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:08,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:08,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:08,412 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 17:56:08,412 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-13 17:56:08,412 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:56:08,412 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:08,412 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:56:08,413 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:08,413 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 17:56:08,414 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:56:08,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:08,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:56:08,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:56:08,414 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-13 17:56:08,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:56:08,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:56:08,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:08,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:08,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:56:08,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:08,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:08,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:56:08,416 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 17:56:08,416 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-13 17:56:08,416 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:56:08,416 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:56:08,416 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:08,416 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:56:08,418 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:08,418 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:08,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:08,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:08,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:56:08,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:08,418 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:56:08,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:56:08,418 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:08,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:56:08,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:56:08,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:56:08,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:08,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:08,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:56:08,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:08,419 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:08,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:08,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:56:08,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:08,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:08,421 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:08,421 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:56:08,421 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:08,421 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:56:08,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:56:08,422 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 17:56:08,422 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:56:08,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:56:08,422 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 17:56:08,422 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:56:08,422 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:08,422 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:08,422 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:08,422 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:08,422 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 17:56:08,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:56:08,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:56:08,422 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:08,422 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:56:08,522 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:56:08,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:56:08,524 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41433] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMinorCompactionWithMonthlyPolicy 2023-02-13 17:56:08,526 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] procedure2.ProcedureExecutor(1029): Stored pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-13 17:56:08,527 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-13 17:56:08,527 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=115, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676311568527 2023-02-13 17:56:08,528 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 17:56:08,533 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-13 17:56:08,534 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMinorCompactionWithMonthlyPolicy' and column 'family1' 2023-02-13 17:56:08,534 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 17:56:08,534 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] zookeeper.ReadOnlyZKClient(139): Connect 0x63de63fa to 127.0.0.1:64825 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 17:56:08,540 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@27ce5b0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 17:56:08,540 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 17:56:08,577 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601035448e18aa3674142a8778360ef3f4e17 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601035448e18aa3674142a8778360ef3f4e17 2023-02-13 17:56:08,578 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 17:56:08,591 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 17:56:08,593 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59906, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 17:56:08,598 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 17:56:08,599 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48284, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 17:56:08,607 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/da67f27a8c5241a49c33cf07023ff910 first=Optional[r5] last=Optional[r6] 2023-02-13 17:56:08,608 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1676310958628.09a1ec58cf507f489c469b2ff2ea7e37., hostname=jenkins-hbase4.apache.org,38881,1676310818035, seqNum=2 for row with hfile group [{family1,hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/da67f27a8c5241a49c33cf07023ff910}] 2023-02-13 17:56:08,615 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(763): Validating hfile at hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/da67f27a8c5241a49c33cf07023ff910 for inclusion in 09a1ec58cf507f489c469b2ff2ea7e37/family1 2023-02-13 17:56:08,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-02-13 17:56:08,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 17:56:08,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HRegion(2445): Flush status journal for 09a1ec58cf507f489c469b2ff2ea7e37: 2023-02-13 17:56:08,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/da67f27a8c5241a49c33cf07023ff910 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMinorCompactionWithMonthlyPolicy__krmtet0ultdo9nl0kaickttn4t6ttaoog5q1jiq4cv3qs9fhb23n0bp1dhjm9mju/family1/da67f27a8c5241a49c33cf07023ff910 2023-02-13 17:56:08,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMinorCompactionWithMonthlyPolicy__krmtet0ultdo9nl0kaickttn4t6ttaoog5q1jiq4cv3qs9fhb23n0bp1dhjm9mju/family1/da67f27a8c5241a49c33cf07023ff910 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/49419c808a4c49808903cf624c06e86c_SeqId_44_ 2023-02-13 17:56:08,621 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(849): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMinorCompactionWithMonthlyPolicy__krmtet0ultdo9nl0kaickttn4t6ttaoog5q1jiq4cv3qs9fhb23n0bp1dhjm9mju/family1/da67f27a8c5241a49c33cf07023ff910 into 09a1ec58cf507f489c469b2ff2ea7e37/family1 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/49419c808a4c49808903cf624c06e86c_SeqId_44_ - updating store file list. 2023-02-13 17:56:08,624 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(882): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/49419c808a4c49808903cf624c06e86c_SeqId_44_ into 09a1ec58cf507f489c469b2ff2ea7e37/family1 2023-02-13 17:56:08,624 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(855): Successfully loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMinorCompactionWithMonthlyPolicy__krmtet0ultdo9nl0kaickttn4t6ttaoog5q1jiq4cv3qs9fhb23n0bp1dhjm9mju/family1/da67f27a8c5241a49c33cf07023ff910 into 09a1ec58cf507f489c469b2ff2ea7e37/family1 (new location: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/49419c808a4c49808903cf624c06e86c_SeqId_44_) 2023-02-13 17:56:08,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMinorCompactionWithMonthlyPolicy__krmtet0ultdo9nl0kaickttn4t6ttaoog5q1jiq4cv3qs9fhb23n0bp1dhjm9mju/family1/da67f27a8c5241a49c33cf07023ff910 2023-02-13 17:56:08,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-13 17:56:08,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-13 17:56:08,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(1912): 09a1ec58cf507f489c469b2ff2ea7e37/family1 is initiating minor compaction 2023-02-13 17:56:08,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@278f3e78; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 17:56:08,627 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 09a1ec58cf507f489c469b2ff2ea7e37/family1 in testMinorCompactionWithMonthlyPolicy,,1676310958628.09a1ec58cf507f489c469b2ff2ea7e37. 2023-02-13 17:56:08,627 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/5754cf4dc7234144935de79459f59b1f, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/7cb5681832be45fbb53117322eea09fb, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/787a0aa7342244598a5d2b2ed7b060fe, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/7537eb22e5d847cb80cb511ad1da4793, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/1b24adfdbd214c288aa66d7db88311fd, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/ba4c5bf7d0cd41fd91f767e3434c0f10, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/f1af0b1f5a7449d1822ec4ce7e3c676d, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/e3bf010011a549048746f7243f52b908, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/d18dd14724094c3796edebc081ed55d8, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/49419c808a4c49808903cf624c06e86c_SeqId_44_] into tmpdir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/.tmp, totalSize=49.7 K 2023-02-13 17:56:08,627 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting 5754cf4dc7234144935de79459f59b1f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-13 17:56:08,627 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting 7cb5681832be45fbb53117322eea09fb, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-13 17:56:08,627 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting 787a0aa7342244598a5d2b2ed7b060fe, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-13 17:56:08,628 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting 7537eb22e5d847cb80cb511ad1da4793, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-13 17:56:08,628 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting 1b24adfdbd214c288aa66d7db88311fd, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-13 17:56:08,628 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting ba4c5bf7d0cd41fd91f767e3434c0f10, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-13 17:56:08,628 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting f1af0b1f5a7449d1822ec4ce7e3c676d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-13 17:56:08,628 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting e3bf010011a549048746f7243f52b908, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-13 17:56:08,628 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting d18dd14724094c3796edebc081ed55d8, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-13 17:56:08,628 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting 49419c808a4c49808903cf624c06e86c_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-13 17:56:08,630 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 17:56:08,630 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:56:08,632 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101f47aa73480dc4fb1b79607cc7b76ae4a to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101f47aa73480dc4fb1b79607cc7b76ae4a 2023-02-13 17:56:08,633 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103afe6c61ee70b45319c6f8afa5a0044c3 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103afe6c61ee70b45319c6f8afa5a0044c3 2023-02-13 17:56:08,633 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-02-13 17:56:08,633 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-02-13 17:56:08,633 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 17:56:08,634 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 17:56:08,662 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] throttle.PressureAwareThroughputController(145): 09a1ec58cf507f489c469b2ff2ea7e37#family1#compaction#166 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 17:56:09,475 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/.tmp/family1/eb735cec2af341879e354d85a6ca8ea2 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/eb735cec2af341879e354d85a6ca8ea2 2023-02-13 17:56:09,480 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 09a1ec58cf507f489c469b2ff2ea7e37/family1 of 09a1ec58cf507f489c469b2ff2ea7e37 into eb735cec2af341879e354d85a6ca8ea2(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 17:56:09,480 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 09a1ec58cf507f489c469b2ff2ea7e37: 2023-02-13 17:56:09,480 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1676310958628.09a1ec58cf507f489c469b2ff2ea7e37., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1676310968627; duration=0sec 2023-02-13 17:56:09,480 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 17:56:09,480 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512315fc8d7588d6a43928f2134b432690e21 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512315fc8d7588d6a43928f2134b432690e21 2023-02-13 17:56:09,481 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 17:56:09,507 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/666eb69770d6428d9f5e4ac73b26a5fe first=Optional[r1] last=Optional[r4] 2023-02-13 17:56:09,508 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1676310958628.09a1ec58cf507f489c469b2ff2ea7e37., hostname=jenkins-hbase4.apache.org,38881,1676310818035, seqNum=2 for row with hfile group [{family1,hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/666eb69770d6428d9f5e4ac73b26a5fe}] 2023-02-13 17:56:09,509 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(763): Validating hfile at hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/666eb69770d6428d9f5e4ac73b26a5fe for inclusion in 09a1ec58cf507f489c469b2ff2ea7e37/family1 2023-02-13 17:56:09,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-02-13 17:56:09,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 17:56:09,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HRegion(2445): Flush status journal for 09a1ec58cf507f489c469b2ff2ea7e37: 2023-02-13 17:56:09,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/666eb69770d6428d9f5e4ac73b26a5fe to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMinorCompactionWithMonthlyPolicy__kri14kbfn43tdic8bu42md1j8lt0a57ssaf3oorj761fi86rjt8mqcao8ub3k2vd/family1/666eb69770d6428d9f5e4ac73b26a5fe 2023-02-13 17:56:09,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMinorCompactionWithMonthlyPolicy__kri14kbfn43tdic8bu42md1j8lt0a57ssaf3oorj761fi86rjt8mqcao8ub3k2vd/family1/666eb69770d6428d9f5e4ac73b26a5fe as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/3bdfff97f4844dd7976b44e4a2f32b39_SeqId_47_ 2023-02-13 17:56:09,514 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(849): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMinorCompactionWithMonthlyPolicy__kri14kbfn43tdic8bu42md1j8lt0a57ssaf3oorj761fi86rjt8mqcao8ub3k2vd/family1/666eb69770d6428d9f5e4ac73b26a5fe into 09a1ec58cf507f489c469b2ff2ea7e37/family1 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/3bdfff97f4844dd7976b44e4a2f32b39_SeqId_47_ - updating store file list. 2023-02-13 17:56:09,516 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(882): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/3bdfff97f4844dd7976b44e4a2f32b39_SeqId_47_ into 09a1ec58cf507f489c469b2ff2ea7e37/family1 2023-02-13 17:56:09,516 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(855): Successfully loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMinorCompactionWithMonthlyPolicy__kri14kbfn43tdic8bu42md1j8lt0a57ssaf3oorj761fi86rjt8mqcao8ub3k2vd/family1/666eb69770d6428d9f5e4ac73b26a5fe into 09a1ec58cf507f489c469b2ff2ea7e37/family1 (new location: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/3bdfff97f4844dd7976b44e4a2f32b39_SeqId_47_) 2023-02-13 17:56:09,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMinorCompactionWithMonthlyPolicy__kri14kbfn43tdic8bu42md1j8lt0a57ssaf3oorj761fi86rjt8mqcao8ub3k2vd/family1/666eb69770d6428d9f5e4ac73b26a5fe 2023-02-13 17:56:09,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-13 17:56:09,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-13 17:56:09,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(1912): 09a1ec58cf507f489c469b2ff2ea7e37/family1 is initiating minor compaction (all files) 2023-02-13 17:56:09,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@41c5b309; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 17:56:09,518 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 09a1ec58cf507f489c469b2ff2ea7e37/family1 in testMinorCompactionWithMonthlyPolicy,,1676310958628.09a1ec58cf507f489c469b2ff2ea7e37. 2023-02-13 17:56:09,518 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/c1d7b82c8e7e40be992f2815a6a10862, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/eb735cec2af341879e354d85a6ca8ea2, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/3bdfff97f4844dd7976b44e4a2f32b39_SeqId_47_] into tmpdir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/.tmp, totalSize=178.1 K 2023-02-13 17:56:09,518 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting c1d7b82c8e7e40be992f2815a6a10862, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878841551 2023-02-13 17:56:09,519 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting eb735cec2af341879e354d85a6ca8ea2, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621241551 2023-02-13 17:56:09,519 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] compactions.Compactor(207): Compacting 3bdfff97f4844dd7976b44e4a2f32b39_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965241551 2023-02-13 17:56:09,520 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 17:56:09,521 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:56:09,522 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201bd682a4d94594a7daa36ff5a604ace03 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201bd682a4d94594a7daa36ff5a604ace03 2023-02-13 17:56:09,524 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512055825f4683af548488eccb1d3f49e91ee to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512055825f4683af548488eccb1d3f49e91ee 2023-02-13 17:56:09,525 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228df1125a11d9e48b8a059c8e44292e23f to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228df1125a11d9e48b8a059c8e44292e23f 2023-02-13 17:56:09,526 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512310c53f1c65eb64c589f95a92523098789 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512310c53f1c65eb64c589f95a92523098789 2023-02-13 17:56:09,526 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-02-13 17:56:09,526 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-02-13 17:56:09,528 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 17:56:09,528 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 17:56:09,535 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] throttle.PressureAwareThroughputController(145): 09a1ec58cf507f489c469b2ff2ea7e37#family1#compaction#167 average throughput is 17.29 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 17:56:09,544 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/5754cf4dc7234144935de79459f59b1f, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/7cb5681832be45fbb53117322eea09fb, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/787a0aa7342244598a5d2b2ed7b060fe, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/7537eb22e5d847cb80cb511ad1da4793, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/1b24adfdbd214c288aa66d7db88311fd, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/ba4c5bf7d0cd41fd91f767e3434c0f10, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/f1af0b1f5a7449d1822ec4ce7e3c676d, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/e3bf010011a549048746f7243f52b908, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/d18dd14724094c3796edebc081ed55d8, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/49419c808a4c49808903cf624c06e86c_SeqId_44_] to archive 2023-02-13 17:56:09,545 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:56:09,552 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/5754cf4dc7234144935de79459f59b1f to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/5754cf4dc7234144935de79459f59b1f 2023-02-13 17:56:09,554 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/7cb5681832be45fbb53117322eea09fb to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/7cb5681832be45fbb53117322eea09fb 2023-02-13 17:56:09,555 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/787a0aa7342244598a5d2b2ed7b060fe to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/787a0aa7342244598a5d2b2ed7b060fe 2023-02-13 17:56:09,557 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/7537eb22e5d847cb80cb511ad1da4793 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/7537eb22e5d847cb80cb511ad1da4793 2023-02-13 17:56:09,558 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/1b24adfdbd214c288aa66d7db88311fd to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/1b24adfdbd214c288aa66d7db88311fd 2023-02-13 17:56:09,559 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/ba4c5bf7d0cd41fd91f767e3434c0f10 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/ba4c5bf7d0cd41fd91f767e3434c0f10 2023-02-13 17:56:09,560 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/f1af0b1f5a7449d1822ec4ce7e3c676d to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/f1af0b1f5a7449d1822ec4ce7e3c676d 2023-02-13 17:56:09,561 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/e3bf010011a549048746f7243f52b908 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/e3bf010011a549048746f7243f52b908 2023-02-13 17:56:09,563 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/d18dd14724094c3796edebc081ed55d8 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/d18dd14724094c3796edebc081ed55d8 2023-02-13 17:56:09,564 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/49419c808a4c49808903cf624c06e86c_SeqId_44_ to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/49419c808a4c49808903cf624c06e86c_SeqId_44_ 2023-02-13 17:56:09,967 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/.tmp/family1/015c9ae776a243ce978f8c0f30a5d5e8 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/015c9ae776a243ce978f8c0f30a5d5e8 2023-02-13 17:56:09,971 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 09a1ec58cf507f489c469b2ff2ea7e37/family1 of 09a1ec58cf507f489c469b2ff2ea7e37 into 015c9ae776a243ce978f8c0f30a5d5e8(size=167.7 K), total size for store is 167.7 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 17:56:09,971 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 09a1ec58cf507f489c469b2ff2ea7e37: 2023-02-13 17:56:09,971 INFO [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1676310958628.09a1ec58cf507f489c469b2ff2ea7e37., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1676310969518; duration=0sec 2023-02-13 17:56:09,971 DEBUG [RS:0;jenkins-hbase4:38881-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 17:56:10,037 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/c1d7b82c8e7e40be992f2815a6a10862, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/eb735cec2af341879e354d85a6ca8ea2, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/3bdfff97f4844dd7976b44e4a2f32b39_SeqId_47_] to archive 2023-02-13 17:56:10,037 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:56:10,039 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/c1d7b82c8e7e40be992f2815a6a10862 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/c1d7b82c8e7e40be992f2815a6a10862 2023-02-13 17:56:10,040 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/eb735cec2af341879e354d85a6ca8ea2 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/eb735cec2af341879e354d85a6ca8ea2 2023-02-13 17:56:10,041 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/3bdfff97f4844dd7976b44e4a2f32b39_SeqId_47_ to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/3bdfff97f4844dd7976b44e4a2f32b39_SeqId_47_ 2023-02-13 17:56:10,377 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130d51c3948162747f5af49e12c0436aeb2 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130d51c3948162747f5af49e12c0436aeb2 2023-02-13 17:56:10,378 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 17:56:10,405 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/46303b8a5363433db53db4df99b07226 first=Optional[r00] last=Optional[r8] 2023-02-13 17:56:10,406 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1676310958628.09a1ec58cf507f489c469b2ff2ea7e37., hostname=jenkins-hbase4.apache.org,38881,1676310818035, seqNum=2 for row with hfile group [{family1,hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/46303b8a5363433db53db4df99b07226}] 2023-02-13 17:56:10,408 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(763): Validating hfile at hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/46303b8a5363433db53db4df99b07226 for inclusion in 09a1ec58cf507f489c469b2ff2ea7e37/family1 2023-02-13 17:56:10,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-02-13 17:56:10,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 17:56:10,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HRegion(2445): Flush status journal for 09a1ec58cf507f489c469b2ff2ea7e37: 2023-02-13 17:56:10,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/46303b8a5363433db53db4df99b07226 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMinorCompactionWithMonthlyPolicy__f4g77ma9s8b8fmch2sqqlurur0ia01ujmajpr8ala33l0qp9d0ujih5sqj7qkpfm/family1/46303b8a5363433db53db4df99b07226 2023-02-13 17:56:10,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMinorCompactionWithMonthlyPolicy__f4g77ma9s8b8fmch2sqqlurur0ia01ujmajpr8ala33l0qp9d0ujih5sqj7qkpfm/family1/46303b8a5363433db53db4df99b07226 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/285188c0e548413d879569959d5c0e12_SeqId_50_ 2023-02-13 17:56:10,413 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(849): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMinorCompactionWithMonthlyPolicy__f4g77ma9s8b8fmch2sqqlurur0ia01ujmajpr8ala33l0qp9d0ujih5sqj7qkpfm/family1/46303b8a5363433db53db4df99b07226 into 09a1ec58cf507f489c469b2ff2ea7e37/family1 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/285188c0e548413d879569959d5c0e12_SeqId_50_ - updating store file list. 2023-02-13 17:56:10,415 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(882): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/285188c0e548413d879569959d5c0e12_SeqId_50_ into 09a1ec58cf507f489c469b2ff2ea7e37/family1 2023-02-13 17:56:10,415 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(855): Successfully loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMinorCompactionWithMonthlyPolicy__f4g77ma9s8b8fmch2sqqlurur0ia01ujmajpr8ala33l0qp9d0ujih5sqj7qkpfm/family1/46303b8a5363433db53db4df99b07226 into 09a1ec58cf507f489c469b2ff2ea7e37/family1 (new location: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/family1/285188c0e548413d879569959d5c0e12_SeqId_50_) 2023-02-13 17:56:10,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMinorCompactionWithMonthlyPolicy__f4g77ma9s8b8fmch2sqqlurur0ia01ujmajpr8ala33l0qp9d0ujih5sqj7qkpfm/family1/46303b8a5363433db53db4df99b07226 2023-02-13 17:56:10,417 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 17:56:10,417 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:56:10,419 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120e97f39d35bca435385eaafdc28c783fa to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120e97f39d35bca435385eaafdc28c783fa 2023-02-13 17:56:10,420 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128a1c7fb65fe6e428abcb55b474ee9b50e to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128a1c7fb65fe6e428abcb55b474ee9b50e 2023-02-13 17:56:10,421 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130eb6155d701084c188fb81f2002a98abc to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130eb6155d701084c188fb81f2002a98abc 2023-02-13 17:56:10,421 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-02-13 17:56:10,421 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-13 17:56:10,421 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 17:56:10,421 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 17:56:10,422 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 17:56:10,422 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 17:56:10,422 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 17:56:10,424 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=115, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-13 17:56:10,425 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=115, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 1.8990 sec 2023-02-13 17:56:10,617 INFO [Listener at localhost/35343] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=253 (was 255), OpenFileDescriptor=639 (was 650), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=122 (was 138), ProcessCount=168 (was 168), AvailableMemoryMB=776 (was 874) 2023-02-13 17:56:10,631 INFO [Listener at localhost/35343] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=253, OpenFileDescriptor=639, MaxFileDescriptor=60000, SystemLoadAverage=122, ProcessCount=168, AvailableMemoryMB=773 2023-02-13 17:56:10,655 DEBUG [Listener at localhost/35343] crypto.Encryption(565): Installed org.apache.hadoop.hbase.io.crypto.KeyProviderForTesting into key provider cache 2023-02-13 17:56:10,718 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10,\xE9\x8D\x84y"Tt\xC0\xA0\x0Bx\x15\xF6\xD2\x99"\x10\x8D\xDE\xD5\x8D\xAAxc\xE3\x5C\x83\x0F'\xA2(\xDAk*\x10\xE4~\xDFx}\xE8\xB5C\xF4\xBF\xB9\xD2\xE5\xDEZ,2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-13 17:56:10,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] procedure2.ProcedureExecutor(1029): Stored pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionFromAdmin 2023-02-13 17:56:10,720 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 17:56:10,721 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionFromAdmin" procId is: 116 2023-02-13 17:56:10,721 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 17:56:10,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-13 17:56:10,723 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa 2023-02-13 17:56:10,723 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d 2023-02-13 17:56:10,723 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9 2023-02-13 17:56:10,723 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa empty. 2023-02-13 17:56:10,723 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d empty. 2023-02-13 17:56:10,723 DEBUG [HFileArchiver-22] backup.HFileArchiver(153): Directory hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9 empty. 2023-02-13 17:56:10,724 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa 2023-02-13 17:56:10,724 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d 2023-02-13 17:56:10,724 DEBUG [HFileArchiver-22] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9 2023-02-13 17:56:10,724 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMajorCompactionFromAdmin regions 2023-02-13 17:56:10,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-13 17:56:11,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-13 17:56:11,131 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp/data/default/testMajorCompactionFromAdmin/.tabledesc/.tableinfo.0000000001 2023-02-13 17:56:11,133 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(7671): creating {ENCODED => b2577b3a58833b8face4a64b8622245d, NAME => 'testMajorCompactionFromAdmin,1,1676310970679.b2577b3a58833b8face4a64b8622245d.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10,\xE9\x8D\x84y"Tt\xC0\xA0\x0Bx\x15\xF6\xD2\x99"\x10\x8D\xDE\xD5\x8D\xAAxc\xE3\x5C\x83\x0F'\xA2(\xDAk*\x10\xE4~\xDFx}\xE8\xB5C\xF4\xBF\xB9\xD2\xE5\xDEZ,2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp 2023-02-13 17:56:11,133 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(7671): creating {ENCODED => d32e83c04cf3e74b17ece5b86cf212fa, NAME => 'testMajorCompactionFromAdmin,,1676310970679.d32e83c04cf3e74b17ece5b86cf212fa.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10,\xE9\x8D\x84y"Tt\xC0\xA0\x0Bx\x15\xF6\xD2\x99"\x10\x8D\xDE\xD5\x8D\xAAxc\xE3\x5C\x83\x0F'\xA2(\xDAk*\x10\xE4~\xDFx}\xE8\xB5C\xF4\xBF\xB9\xD2\xE5\xDEZ,2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp 2023-02-13 17:56:11,133 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(7671): creating {ENCODED => 900ab85ad5988d481ec376125f462db9, NAME => 'testMajorCompactionFromAdmin,2,1676310970679.900ab85ad5988d481ec376125f462db9.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10,\xE9\x8D\x84y"Tt\xC0\xA0\x0Bx\x15\xF6\xD2\x99"\x10\x8D\xDE\xD5\x8D\xAAxc\xE3\x5C\x83\x0F'\xA2(\xDAk*\x10\xE4~\xDFx}\xE8\xB5C\xF4\xBF\xB9\xD2\xE5\xDEZ,2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/.tmp 2023-02-13 17:56:11,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-13 17:56:11,542 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,1,1676310970679.b2577b3a58833b8face4a64b8622245d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 17:56:11,542 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,,1676310970679.d32e83c04cf3e74b17ece5b86cf212fa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 17:56:11,542 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,2,1676310970679.900ab85ad5988d481ec376125f462db9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 17:56:11,543 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1603): Closing d32e83c04cf3e74b17ece5b86cf212fa, disabling compactions & flushes 2023-02-13 17:56:11,543 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1603): Closing 900ab85ad5988d481ec376125f462db9, disabling compactions & flushes 2023-02-13 17:56:11,543 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,,1676310970679.d32e83c04cf3e74b17ece5b86cf212fa. 2023-02-13 17:56:11,543 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,2,1676310970679.900ab85ad5988d481ec376125f462db9. 2023-02-13 17:56:11,543 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1676310970679.d32e83c04cf3e74b17ece5b86cf212fa. 2023-02-13 17:56:11,542 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1603): Closing b2577b3a58833b8face4a64b8622245d, disabling compactions & flushes 2023-02-13 17:56:11,543 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,,1676310970679.d32e83c04cf3e74b17ece5b86cf212fa. after waiting 0 ms 2023-02-13 17:56:11,543 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1676310970679.900ab85ad5988d481ec376125f462db9. 2023-02-13 17:56:11,543 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,,1676310970679.d32e83c04cf3e74b17ece5b86cf212fa. 2023-02-13 17:56:11,543 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,2,1676310970679.900ab85ad5988d481ec376125f462db9. after waiting 0 ms 2023-02-13 17:56:11,543 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,,1676310970679.d32e83c04cf3e74b17ece5b86cf212fa. 2023-02-13 17:56:11,543 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,1,1676310970679.b2577b3a58833b8face4a64b8622245d. 2023-02-13 17:56:11,543 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1557): Region close journal for d32e83c04cf3e74b17ece5b86cf212fa: Waiting for close lock at 1676310971543Disabling compacts and flushes for region at 1676310971543Disabling writes for close at 1676310971543Writing region close event to WAL at 1676310971543Closed at 1676310971543 2023-02-13 17:56:11,543 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,2,1676310970679.900ab85ad5988d481ec376125f462db9. 2023-02-13 17:56:11,543 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1676310970679.b2577b3a58833b8face4a64b8622245d. 2023-02-13 17:56:11,543 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,2,1676310970679.900ab85ad5988d481ec376125f462db9. 2023-02-13 17:56:11,543 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,1,1676310970679.b2577b3a58833b8face4a64b8622245d. after waiting 0 ms 2023-02-13 17:56:11,543 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,1,1676310970679.b2577b3a58833b8face4a64b8622245d. 2023-02-13 17:56:11,543 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1557): Region close journal for 900ab85ad5988d481ec376125f462db9: Waiting for close lock at 1676310971543Disabling compacts and flushes for region at 1676310971543Disabling writes for close at 1676310971543Writing region close event to WAL at 1676310971543Closed at 1676310971543 2023-02-13 17:56:11,543 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,1,1676310970679.b2577b3a58833b8face4a64b8622245d. 2023-02-13 17:56:11,543 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1557): Region close journal for b2577b3a58833b8face4a64b8622245d: Waiting for close lock at 1676310971542Disabling compacts and flushes for region at 1676310971542Disabling writes for close at 1676310971543 (+1 ms)Writing region close event to WAL at 1676310971543Closed at 1676310971543 2023-02-13 17:56:11,545 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 17:56:11,546 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,,1676310970679.d32e83c04cf3e74b17ece5b86cf212fa.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676310971546"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676310971546"}]},"ts":"1676310971546"} 2023-02-13 17:56:11,546 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,2,1676310970679.900ab85ad5988d481ec376125f462db9.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676310971546"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676310971546"}]},"ts":"1676310971546"} 2023-02-13 17:56:11,546 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,1,1676310970679.b2577b3a58833b8face4a64b8622245d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1676310971546"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676310971546"}]},"ts":"1676310971546"} 2023-02-13 17:56:11,548 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-13 17:56:11,549 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 17:56:11,549 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676310971549"}]},"ts":"1676310971549"} 2023-02-13 17:56:11,550 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLING in hbase:meta 2023-02-13 17:56:11,553 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=d32e83c04cf3e74b17ece5b86cf212fa, ASSIGN}, {pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=b2577b3a58833b8face4a64b8622245d, ASSIGN}, {pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=900ab85ad5988d481ec376125f462db9, ASSIGN}] 2023-02-13 17:56:11,555 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=900ab85ad5988d481ec376125f462db9, ASSIGN 2023-02-13 17:56:11,555 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=d32e83c04cf3e74b17ece5b86cf212fa, ASSIGN 2023-02-13 17:56:11,555 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=b2577b3a58833b8face4a64b8622245d, ASSIGN 2023-02-13 17:56:11,555 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=900ab85ad5988d481ec376125f462db9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38881,1676310818035; forceNewPlan=false, retain=false 2023-02-13 17:56:11,555 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=d32e83c04cf3e74b17ece5b86cf212fa, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38881,1676310818035; forceNewPlan=false, retain=false 2023-02-13 17:56:11,556 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=b2577b3a58833b8face4a64b8622245d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38881,1676310818035; forceNewPlan=false, retain=false 2023-02-13 17:56:11,707 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=b2577b3a58833b8face4a64b8622245d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:11,707 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=900ab85ad5988d481ec376125f462db9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:11,707 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=d32e83c04cf3e74b17ece5b86cf212fa, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:11,707 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,2,1676310970679.900ab85ad5988d481ec376125f462db9.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676310971707"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676310971707"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676310971707"}]},"ts":"1676310971707"} 2023-02-13 17:56:11,707 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,,1676310970679.d32e83c04cf3e74b17ece5b86cf212fa.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676310971707"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676310971707"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676310971707"}]},"ts":"1676310971707"} 2023-02-13 17:56:11,707 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,1,1676310970679.b2577b3a58833b8face4a64b8622245d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1676310971707"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676310971707"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676310971707"}]},"ts":"1676310971707"} 2023-02-13 17:56:11,709 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=120, ppid=119, state=RUNNABLE; OpenRegionProcedure 900ab85ad5988d481ec376125f462db9, server=jenkins-hbase4.apache.org,38881,1676310818035}] 2023-02-13 17:56:11,709 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=121, ppid=117, state=RUNNABLE; OpenRegionProcedure d32e83c04cf3e74b17ece5b86cf212fa, server=jenkins-hbase4.apache.org,38881,1676310818035}] 2023-02-13 17:56:11,710 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=122, ppid=118, state=RUNNABLE; OpenRegionProcedure b2577b3a58833b8face4a64b8622245d, server=jenkins-hbase4.apache.org,38881,1676310818035}] 2023-02-13 17:56:11,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-13 17:56:11,863 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,2,1676310970679.900ab85ad5988d481ec376125f462db9. 2023-02-13 17:56:11,863 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 900ab85ad5988d481ec376125f462db9, NAME => 'testMajorCompactionFromAdmin,2,1676310970679.900ab85ad5988d481ec376125f462db9.', STARTKEY => '2', ENDKEY => ''} 2023-02-13 17:56:11,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 900ab85ad5988d481ec376125f462db9 2023-02-13 17:56:11,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,2,1676310970679.900ab85ad5988d481ec376125f462db9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 17:56:11,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 900ab85ad5988d481ec376125f462db9 2023-02-13 17:56:11,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 900ab85ad5988d481ec376125f462db9 2023-02-13 17:56:11,885 INFO [StoreOpener-900ab85ad5988d481ec376125f462db9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 900ab85ad5988d481ec376125f462db9 2023-02-13 17:56:11,887 DEBUG [StoreOpener-900ab85ad5988d481ec376125f462db9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family1 2023-02-13 17:56:11,887 DEBUG [StoreOpener-900ab85ad5988d481ec376125f462db9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family1 2023-02-13 17:56:11,887 INFO [StoreOpener-900ab85ad5988d481ec376125f462db9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 900ab85ad5988d481ec376125f462db9 columnFamilyName family1 2023-02-13 17:56:11,888 INFO [StoreOpener-900ab85ad5988d481ec376125f462db9-1] regionserver.HStore(310): Store=900ab85ad5988d481ec376125f462db9/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 17:56:11,889 INFO [StoreOpener-900ab85ad5988d481ec376125f462db9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 900ab85ad5988d481ec376125f462db9 2023-02-13 17:56:11,890 DEBUG [StoreOpener-900ab85ad5988d481ec376125f462db9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family2 2023-02-13 17:56:11,890 DEBUG [StoreOpener-900ab85ad5988d481ec376125f462db9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family2 2023-02-13 17:56:11,890 INFO [StoreOpener-900ab85ad5988d481ec376125f462db9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 900ab85ad5988d481ec376125f462db9 columnFamilyName family2 2023-02-13 17:56:11,891 INFO [StoreOpener-900ab85ad5988d481ec376125f462db9-1] regionserver.HStore(310): Store=900ab85ad5988d481ec376125f462db9/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 17:56:11,892 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9 2023-02-13 17:56:11,892 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9 2023-02-13 17:56:11,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 17:56:11,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 900ab85ad5988d481ec376125f462db9 2023-02-13 17:56:11,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 17:56:11,896 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 900ab85ad5988d481ec376125f462db9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62398628, jitterRate=-0.07018798589706421}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 17:56:11,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 900ab85ad5988d481ec376125f462db9: Running coprocessor pre-open hook at 1676310971864Writing region info on filesystem at 1676310971864Initializing all the Stores at 1676310971865 (+1 ms)Instantiating store for column family {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10,\xE9\x8D\x84y"Tt\xC0\xA0\x0Bx\x15\xF6\xD2\x99"\x10\x8D\xDE\xD5\x8D\xAAxc\xE3\x5C\x83\x0F'\xA2(\xDAk*\x10\xE4~\xDFx}\xE8\xB5C\xF4\xBF\xB9\xD2\xE5\xDEZ,2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676310971865Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676310971865Cleaning up temporary data from old regions at 1676310971893 (+28 ms)Cleaning up detritus from prior splits at 1676310971893Running coprocessor post-open hooks at 1676310971896 (+3 ms)Region opened successfully at 1676310971896 2023-02-13 17:56:11,897 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,2,1676310970679.900ab85ad5988d481ec376125f462db9., pid=120, masterSystemTime=1676310971861 2023-02-13 17:56:11,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,2,1676310970679.900ab85ad5988d481ec376125f462db9. 2023-02-13 17:56:11,898 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,2,1676310970679.900ab85ad5988d481ec376125f462db9. 2023-02-13 17:56:11,898 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,1,1676310970679.b2577b3a58833b8face4a64b8622245d. 2023-02-13 17:56:11,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b2577b3a58833b8face4a64b8622245d, NAME => 'testMajorCompactionFromAdmin,1,1676310970679.b2577b3a58833b8face4a64b8622245d.', STARTKEY => '1', ENDKEY => '2'} 2023-02-13 17:56:11,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin b2577b3a58833b8face4a64b8622245d 2023-02-13 17:56:11,898 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=900ab85ad5988d481ec376125f462db9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:11,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,1,1676310970679.b2577b3a58833b8face4a64b8622245d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 17:56:11,899 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for b2577b3a58833b8face4a64b8622245d 2023-02-13 17:56:11,899 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,2,1676310970679.900ab85ad5988d481ec376125f462db9.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676310971898"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676310971898"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676310971898"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676310971898"}]},"ts":"1676310971898"} 2023-02-13 17:56:11,899 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for b2577b3a58833b8face4a64b8622245d 2023-02-13 17:56:11,901 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=120, resume processing ppid=119 2023-02-13 17:56:11,901 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=120, ppid=119, state=SUCCESS; OpenRegionProcedure 900ab85ad5988d481ec376125f462db9, server=jenkins-hbase4.apache.org,38881,1676310818035 in 191 msec 2023-02-13 17:56:11,902 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=119, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=900ab85ad5988d481ec376125f462db9, ASSIGN in 348 msec 2023-02-13 17:56:11,919 INFO [StoreOpener-b2577b3a58833b8face4a64b8622245d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b2577b3a58833b8face4a64b8622245d 2023-02-13 17:56:11,920 DEBUG [StoreOpener-b2577b3a58833b8face4a64b8622245d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family1 2023-02-13 17:56:11,920 DEBUG [StoreOpener-b2577b3a58833b8face4a64b8622245d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family1 2023-02-13 17:56:11,921 INFO [StoreOpener-b2577b3a58833b8face4a64b8622245d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b2577b3a58833b8face4a64b8622245d columnFamilyName family1 2023-02-13 17:56:11,921 INFO [StoreOpener-b2577b3a58833b8face4a64b8622245d-1] regionserver.HStore(310): Store=b2577b3a58833b8face4a64b8622245d/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 17:56:11,922 INFO [StoreOpener-b2577b3a58833b8face4a64b8622245d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region b2577b3a58833b8face4a64b8622245d 2023-02-13 17:56:11,922 DEBUG [StoreOpener-b2577b3a58833b8face4a64b8622245d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family2 2023-02-13 17:56:11,923 DEBUG [StoreOpener-b2577b3a58833b8face4a64b8622245d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family2 2023-02-13 17:56:11,923 INFO [StoreOpener-b2577b3a58833b8face4a64b8622245d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b2577b3a58833b8face4a64b8622245d columnFamilyName family2 2023-02-13 17:56:11,923 INFO [StoreOpener-b2577b3a58833b8face4a64b8622245d-1] regionserver.HStore(310): Store=b2577b3a58833b8face4a64b8622245d/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 17:56:11,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d 2023-02-13 17:56:11,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d 2023-02-13 17:56:11,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 17:56:11,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for b2577b3a58833b8face4a64b8622245d 2023-02-13 17:56:11,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 17:56:11,928 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened b2577b3a58833b8face4a64b8622245d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70941930, jitterRate=0.05711713433265686}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 17:56:11,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for b2577b3a58833b8face4a64b8622245d: Running coprocessor pre-open hook at 1676310971899Writing region info on filesystem at 1676310971899Initializing all the Stores at 1676310971899Instantiating store for column family {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10,\xE9\x8D\x84y"Tt\xC0\xA0\x0Bx\x15\xF6\xD2\x99"\x10\x8D\xDE\xD5\x8D\xAAxc\xE3\x5C\x83\x0F'\xA2(\xDAk*\x10\xE4~\xDFx}\xE8\xB5C\xF4\xBF\xB9\xD2\xE5\xDEZ,2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676310971899Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676310971899Cleaning up temporary data from old regions at 1676310971925 (+26 ms)Cleaning up detritus from prior splits at 1676310971925Running coprocessor post-open hooks at 1676310971928 (+3 ms)Region opened successfully at 1676310971928 2023-02-13 17:56:11,929 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,1,1676310970679.b2577b3a58833b8face4a64b8622245d., pid=122, masterSystemTime=1676310971861 2023-02-13 17:56:11,930 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,1,1676310970679.b2577b3a58833b8face4a64b8622245d. 2023-02-13 17:56:11,930 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,1,1676310970679.b2577b3a58833b8face4a64b8622245d. 2023-02-13 17:56:11,930 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,,1676310970679.d32e83c04cf3e74b17ece5b86cf212fa. 2023-02-13 17:56:11,930 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d32e83c04cf3e74b17ece5b86cf212fa, NAME => 'testMajorCompactionFromAdmin,,1676310970679.d32e83c04cf3e74b17ece5b86cf212fa.', STARTKEY => '', ENDKEY => '1'} 2023-02-13 17:56:11,930 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=b2577b3a58833b8face4a64b8622245d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:11,930 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin d32e83c04cf3e74b17ece5b86cf212fa 2023-02-13 17:56:11,930 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,,1676310970679.d32e83c04cf3e74b17ece5b86cf212fa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 17:56:11,930 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,1,1676310970679.b2577b3a58833b8face4a64b8622245d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1676310971930"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676310971930"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676310971930"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676310971930"}]},"ts":"1676310971930"} 2023-02-13 17:56:11,930 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for d32e83c04cf3e74b17ece5b86cf212fa 2023-02-13 17:56:11,930 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for d32e83c04cf3e74b17ece5b86cf212fa 2023-02-13 17:56:11,932 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=122, resume processing ppid=118 2023-02-13 17:56:11,933 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=122, ppid=118, state=SUCCESS; OpenRegionProcedure b2577b3a58833b8face4a64b8622245d, server=jenkins-hbase4.apache.org,38881,1676310818035 in 221 msec 2023-02-13 17:56:11,933 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=b2577b3a58833b8face4a64b8622245d, ASSIGN in 380 msec 2023-02-13 17:56:11,950 INFO [StoreOpener-d32e83c04cf3e74b17ece5b86cf212fa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region d32e83c04cf3e74b17ece5b86cf212fa 2023-02-13 17:56:11,952 DEBUG [StoreOpener-d32e83c04cf3e74b17ece5b86cf212fa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family1 2023-02-13 17:56:11,952 DEBUG [StoreOpener-d32e83c04cf3e74b17ece5b86cf212fa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family1 2023-02-13 17:56:11,952 INFO [StoreOpener-d32e83c04cf3e74b17ece5b86cf212fa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d32e83c04cf3e74b17ece5b86cf212fa columnFamilyName family1 2023-02-13 17:56:11,953 INFO [StoreOpener-d32e83c04cf3e74b17ece5b86cf212fa-1] regionserver.HStore(310): Store=d32e83c04cf3e74b17ece5b86cf212fa/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 17:56:11,953 INFO [StoreOpener-d32e83c04cf3e74b17ece5b86cf212fa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region d32e83c04cf3e74b17ece5b86cf212fa 2023-02-13 17:56:11,954 DEBUG [StoreOpener-d32e83c04cf3e74b17ece5b86cf212fa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family2 2023-02-13 17:56:11,954 DEBUG [StoreOpener-d32e83c04cf3e74b17ece5b86cf212fa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family2 2023-02-13 17:56:11,954 INFO [StoreOpener-d32e83c04cf3e74b17ece5b86cf212fa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d32e83c04cf3e74b17ece5b86cf212fa columnFamilyName family2 2023-02-13 17:56:11,954 INFO [StoreOpener-d32e83c04cf3e74b17ece5b86cf212fa-1] regionserver.HStore(310): Store=d32e83c04cf3e74b17ece5b86cf212fa/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 17:56:11,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa 2023-02-13 17:56:11,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa 2023-02-13 17:56:11,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 17:56:11,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for d32e83c04cf3e74b17ece5b86cf212fa 2023-02-13 17:56:11,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 17:56:11,959 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened d32e83c04cf3e74b17ece5b86cf212fa; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65566399, jitterRate=-0.022984519600868225}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 17:56:11,959 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for d32e83c04cf3e74b17ece5b86cf212fa: Running coprocessor pre-open hook at 1676310971930Writing region info on filesystem at 1676310971930Initializing all the Stores at 1676310971931 (+1 ms)Instantiating store for column family {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10,\xE9\x8D\x84y"Tt\xC0\xA0\x0Bx\x15\xF6\xD2\x99"\x10\x8D\xDE\xD5\x8D\xAAxc\xE3\x5C\x83\x0F'\xA2(\xDAk*\x10\xE4~\xDFx}\xE8\xB5C\xF4\xBF\xB9\xD2\xE5\xDEZ,2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676310971931Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676310971931Cleaning up temporary data from old regions at 1676310971956 (+25 ms)Cleaning up detritus from prior splits at 1676310971956Running coprocessor post-open hooks at 1676310971959 (+3 ms)Region opened successfully at 1676310971959 2023-02-13 17:56:11,959 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,,1676310970679.d32e83c04cf3e74b17ece5b86cf212fa., pid=121, masterSystemTime=1676310971861 2023-02-13 17:56:11,961 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,,1676310970679.d32e83c04cf3e74b17ece5b86cf212fa. 2023-02-13 17:56:11,961 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,,1676310970679.d32e83c04cf3e74b17ece5b86cf212fa. 2023-02-13 17:56:11,961 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=d32e83c04cf3e74b17ece5b86cf212fa, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:11,961 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,,1676310970679.d32e83c04cf3e74b17ece5b86cf212fa.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676310971961"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676310971961"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676310971961"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676310971961"}]},"ts":"1676310971961"} 2023-02-13 17:56:11,963 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=121, resume processing ppid=117 2023-02-13 17:56:11,963 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=121, ppid=117, state=SUCCESS; OpenRegionProcedure d32e83c04cf3e74b17ece5b86cf212fa, server=jenkins-hbase4.apache.org,38881,1676310818035 in 253 msec 2023-02-13 17:56:11,965 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=116 2023-02-13 17:56:11,965 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=d32e83c04cf3e74b17ece5b86cf212fa, ASSIGN in 410 msec 2023-02-13 17:56:11,965 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 17:56:11,965 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676310971965"}]},"ts":"1676310971965"} 2023-02-13 17:56:11,966 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLED in hbase:meta 2023-02-13 17:56:11,968 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 17:56:11,969 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=116, state=SUCCESS; CreateTableProcedure table=testMajorCompactionFromAdmin in 1.2500 sec 2023-02-13 17:56:12,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-13 17:56:12,826 INFO [Listener at localhost/35343] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionFromAdmin, procId: 116 completed 2023-02-13 17:56:12,833 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,,1676310970679.d32e83c04cf3e74b17ece5b86cf212fa. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 17:56:12,834 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,1,1676310970679.b2577b3a58833b8face4a64b8622245d. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 17:56:12,834 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,2,1676310970679.900ab85ad5988d481ec376125f462db9. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 17:56:12,836 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:56:12,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-13 17:56:12,840 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-13 17:56:12,840 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:56:12,840 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-13 17:56:12,840 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-13 17:56:12,840 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 17:56:12,840 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 17:56:12,847 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:56:12,847 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:12,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:56:12,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:56:12,848 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:12,848 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:56:12,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 17:56:12,848 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 17:56:12,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:56:12,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 17:56:12,852 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-13 17:56:12,852 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-13 17:56:12,852 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-13 17:56:12,852 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:56:12,852 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-13 17:56:12,856 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1676310970679.900ab85ad5988d481ec376125f462db9. 2023-02-13 17:56:12,856 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1676310970679.900ab85ad5988d481ec376125f462db9. started... 2023-02-13 17:56:12,856 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1676310970679.b2577b3a58833b8face4a64b8622245d. 2023-02-13 17:56:12,856 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1676310970679.b2577b3a58833b8face4a64b8622245d. started... 2023-02-13 17:56:12,856 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 17:56:12,856 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:56:12,859 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1676310970679.d32e83c04cf3e74b17ece5b86cf212fa. 2023-02-13 17:56:12,859 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing b2577b3a58833b8face4a64b8622245d 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-13 17:56:12,859 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1676310970679.d32e83c04cf3e74b17ece5b86cf212fa. started... 2023-02-13 17:56:12,859 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 900ab85ad5988d481ec376125f462db9 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-13 17:56:12,861 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing d32e83c04cf3e74b17ece5b86cf212fa 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-13 17:56:12,938 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021362c8760a56ae4072b056c3ee35af93c1 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023021362c8760a56ae4072b056c3ee35af93c1 2023-02-13 17:56:12,948 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213ac23b14948ab4a199ad883f3b33b6105 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230213ac23b14948ab4a199ad883f3b33b6105 2023-02-13 17:56:12,949 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213d57dd8f115ee459bb1103510aa2c2cfd to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230213d57dd8f115ee459bb1103510aa2c2cfd 2023-02-13 17:56:12,968 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/.tmp/family1/aadba0868c7d4e798af24ee59d5ea0f7 2023-02-13 17:56:12,991 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/.tmp/family1/c4187737aab74e69a6286157637cb736 2023-02-13 17:56:13,028 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213c0149c2b961a4fb4a33aea4b72b2da2a to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230213c0149c2b961a4fb4a33aea4b72b2da2a 2023-02-13 17:56:13,041 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/.tmp/family2/1efe8648f8804b929b2bdb77e49c2706 2023-02-13 17:56:13,045 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021360b83a43cb7944a0a68768d1069def66 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c2023021360b83a43cb7944a0a68768d1069def66 2023-02-13 17:56:13,047 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/.tmp/family1/aadba0868c7d4e798af24ee59d5ea0f7 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family1/aadba0868c7d4e798af24ee59d5ea0f7 2023-02-13 17:56:13,052 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/.tmp/family2/8854f72cded240f0afa9f86796720d6c 2023-02-13 17:56:13,056 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/.tmp/family1/c4187737aab74e69a6286157637cb736 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family1/c4187737aab74e69a6286157637cb736 2023-02-13 17:56:13,079 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family1/aadba0868c7d4e798af24ee59d5ea0f7, entries=4, sequenceid=5, filesize=5.5 K 2023-02-13 17:56:13,080 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/.tmp/family2/1efe8648f8804b929b2bdb77e49c2706 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family2/1efe8648f8804b929b2bdb77e49c2706 2023-02-13 17:56:13,088 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family2/1efe8648f8804b929b2bdb77e49c2706, entries=2, sequenceid=5, filesize=5.1 K 2023-02-13 17:56:13,089 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for d32e83c04cf3e74b17ece5b86cf212fa in 229ms, sequenceid=5, compaction requested=false 2023-02-13 17:56:13,089 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-02-13 17:56:13,091 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family1/c4187737aab74e69a6286157637cb736, entries=4, sequenceid=5, filesize=5.5 K 2023-02-13 17:56:13,091 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for d32e83c04cf3e74b17ece5b86cf212fa: 2023-02-13 17:56:13,091 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1676310970679.d32e83c04cf3e74b17ece5b86cf212fa. 2023-02-13 17:56:13,091 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 17:56:13,091 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/.tmp/family2/8854f72cded240f0afa9f86796720d6c as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family2/8854f72cded240f0afa9f86796720d6c 2023-02-13 17:56:13,099 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family2/8854f72cded240f0afa9f86796720d6c, entries=2, sequenceid=5, filesize=5.1 K 2023-02-13 17:56:13,100 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 900ab85ad5988d481ec376125f462db9 in 241ms, sequenceid=5, compaction requested=false 2023-02-13 17:56:13,101 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 900ab85ad5988d481ec376125f462db9: 2023-02-13 17:56:13,102 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1676310970679.900ab85ad5988d481ec376125f462db9. 2023-02-13 17:56:13,102 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 17:56:13,378 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/.tmp/family1/fd7399ba6a16483c9393d850baff72fb 2023-02-13 17:56:13,826 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021332023603cb6f4ecaa28ce51c22730146 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023021332023603cb6f4ecaa28ce51c22730146 2023-02-13 17:56:14,232 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/.tmp/family2/e098512c30c5437f9e842eeba18c568f 2023-02-13 17:56:14,237 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/.tmp/family1/fd7399ba6a16483c9393d850baff72fb as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family1/fd7399ba6a16483c9393d850baff72fb 2023-02-13 17:56:14,261 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family1/fd7399ba6a16483c9393d850baff72fb, entries=4, sequenceid=5, filesize=5.5 K 2023-02-13 17:56:14,261 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/.tmp/family2/e098512c30c5437f9e842eeba18c568f as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family2/e098512c30c5437f9e842eeba18c568f 2023-02-13 17:56:14,265 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family2/e098512c30c5437f9e842eeba18c568f, entries=2, sequenceid=5, filesize=5.1 K 2023-02-13 17:56:14,266 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for b2577b3a58833b8face4a64b8622245d in 1407ms, sequenceid=5, compaction requested=false 2023-02-13 17:56:14,266 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for b2577b3a58833b8face4a64b8622245d: 2023-02-13 17:56:14,266 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1676310970679.b2577b3a58833b8face4a64b8622245d. 2023-02-13 17:56:14,266 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 17:56:14,266 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 17:56:14,266 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:14,266 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-13 17:56:14,266 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-13 17:56:14,268 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 17:56:14,268 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:14,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:14,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:56:14,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:56:14,268 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 17:56:14,268 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:56:14,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:56:14,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:56:14,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 17:56:14,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:14,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:56:14,269 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-13 17:56:14,269 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@640f58a2[Count = 0] remaining members to acquire global barrier 2023-02-13 17:56:14,269 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-13 17:56:14,269 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 17:56:14,270 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 17:56:14,270 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 17:56:14,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 17:56:14,270 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-13 17:56:14,270 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-13 17:56:14,270 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:56:14,270 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:14,271 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:56:14,272 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-13 17:56:14,272 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:14,272 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:56:14,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:14,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:56:14,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:56:14,272 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-13 17:56:14,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:56:14,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:56:14,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 17:56:14,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:14,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:56:14,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 17:56:14,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:14,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:56:14,274 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-13 17:56:14,274 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-13 17:56:14,274 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:56:14,274 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:56:14,274 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-13 17:56:14,274 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:56:14,276 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 17:56:14,276 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 17:56:14,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 17:56:14,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 17:56:14,276 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:56:14,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 17:56:14,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:56:14,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:56:14,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:56:14,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:56:14,277 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:14,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:56:14,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 17:56:14,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 17:56:14,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:56:14,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 17:56:14,278 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:14,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:14,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:56:14,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 17:56:14,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:14,280 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:56:14,280 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:56:14,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:56:14,280 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-13 17:56:14,280 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:56:14,280 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:56:14,280 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-02-13 17:56:14,280 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:14,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:56:14,280 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 17:56:14,280 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-13 17:56:14,281 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:56:14,280 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 17:56:14,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:56:14,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:56:14,281 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:14,281 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 17:56:14,281 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 17:56:14,281 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 17:56:14,381 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:56:14,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:56:14,383 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,,1676310970679.d32e83c04cf3e74b17ece5b86cf212fa. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 17:56:14,383 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,1,1676310970679.b2577b3a58833b8face4a64b8622245d. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 17:56:14,383 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,2,1676310970679.900ab85ad5988d481ec376125f462db9. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 17:56:14,385 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:56:14,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-02-13 17:56:14,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-13 17:56:14,387 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-13 17:56:14,387 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:56:14,387 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-13 17:56:14,387 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-13 17:56:14,387 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 17:56:14,387 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 17:56:14,389 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:56:14,389 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:14,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:56:14,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:56:14,389 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:14,389 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:56:14,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 17:56:14,389 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 17:56:14,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:56:14,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 17:56:14,390 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-13 17:56:14,390 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-02-13 17:56:14,390 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-13 17:56:14,390 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-13 17:56:14,390 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:56:14,390 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-13 17:56:14,390 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1676310970679.900ab85ad5988d481ec376125f462db9. 2023-02-13 17:56:14,390 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 17:56:14,390 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:56:14,390 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1676310970679.900ab85ad5988d481ec376125f462db9. started... 2023-02-13 17:56:14,390 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1676310970679.b2577b3a58833b8face4a64b8622245d. 2023-02-13 17:56:14,390 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1676310970679.d32e83c04cf3e74b17ece5b86cf212fa. 2023-02-13 17:56:14,390 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 900ab85ad5988d481ec376125f462db9 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-13 17:56:14,390 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1676310970679.d32e83c04cf3e74b17ece5b86cf212fa. started... 2023-02-13 17:56:14,390 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1676310970679.b2577b3a58833b8face4a64b8622245d. started... 2023-02-13 17:56:14,391 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing b2577b3a58833b8face4a64b8622245d 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-13 17:56:14,391 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing d32e83c04cf3e74b17ece5b86cf212fa 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-13 17:56:14,841 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213108b47d2400e4e808a890b9338cbb62f to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230213108b47d2400e4e808a890b9338cbb62f 2023-02-13 17:56:14,843 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302134256c087cf7b4e50a5d37b822418482f to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302134256c087cf7b4e50a5d37b822418482f 2023-02-13 17:56:14,847 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213eef8c08f68124362b4af70ddb4b1284e to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230213eef8c08f68124362b4af70ddb4b1284e 2023-02-13 17:56:15,258 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/.tmp/family1/30657e7f938e46eebfa343bcd44f15de 2023-02-13 17:56:15,264 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/.tmp/family1/22726c490fe44e599c03cb15c8e8fd1f 2023-02-13 17:56:15,264 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/.tmp/family1/ebdcee67991c4580ad3e2eb9c35e906b 2023-02-13 17:56:15,292 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213129cf4db939f478c96b2140adffdf802 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230213129cf4db939f478c96b2140adffdf802 2023-02-13 17:56:15,696 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021331b6b0a7e38d489bb5fe894c28c58b72 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023021331b6b0a7e38d489bb5fe894c28c58b72 2023-02-13 17:56:15,698 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/.tmp/family2/5daf98fedc8e4332b464d2f5e538e901 2023-02-13 17:56:15,698 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213e5f275a82a3740e99d686c7fd8d6ae2e to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230213e5f275a82a3740e99d686c7fd8d6ae2e 2023-02-13 17:56:15,702 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/.tmp/family1/30657e7f938e46eebfa343bcd44f15de as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family1/30657e7f938e46eebfa343bcd44f15de 2023-02-13 17:56:15,703 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/.tmp/family2/1c99fde2cb784ca9b49b4882c15a790c 2023-02-13 17:56:15,707 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/.tmp/family1/ebdcee67991c4580ad3e2eb9c35e906b as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family1/ebdcee67991c4580ad3e2eb9c35e906b 2023-02-13 17:56:15,726 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family1/30657e7f938e46eebfa343bcd44f15de, entries=4, sequenceid=9, filesize=5.5 K 2023-02-13 17:56:15,727 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/.tmp/family2/5daf98fedc8e4332b464d2f5e538e901 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family2/5daf98fedc8e4332b464d2f5e538e901 2023-02-13 17:56:15,730 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family2/5daf98fedc8e4332b464d2f5e538e901, entries=2, sequenceid=9, filesize=5.1 K 2023-02-13 17:56:15,731 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for d32e83c04cf3e74b17ece5b86cf212fa in 1340ms, sequenceid=9, compaction requested=false 2023-02-13 17:56:15,731 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for d32e83c04cf3e74b17ece5b86cf212fa: 2023-02-13 17:56:15,731 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1676310970679.d32e83c04cf3e74b17ece5b86cf212fa. 2023-02-13 17:56:15,731 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 17:56:15,741 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family1/ebdcee67991c4580ad3e2eb9c35e906b, entries=4, sequenceid=9, filesize=5.5 K 2023-02-13 17:56:15,742 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/.tmp/family2/1c99fde2cb784ca9b49b4882c15a790c as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family2/1c99fde2cb784ca9b49b4882c15a790c 2023-02-13 17:56:15,745 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family2/1c99fde2cb784ca9b49b4882c15a790c, entries=2, sequenceid=9, filesize=5.1 K 2023-02-13 17:56:15,745 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 900ab85ad5988d481ec376125f462db9 in 1355ms, sequenceid=9, compaction requested=false 2023-02-13 17:56:15,746 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 900ab85ad5988d481ec376125f462db9: 2023-02-13 17:56:15,746 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1676310970679.900ab85ad5988d481ec376125f462db9. 2023-02-13 17:56:15,746 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 17:56:16,102 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/.tmp/family2/fc7b23e79eb641f3ba7a435f02549ca4 2023-02-13 17:56:16,106 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/.tmp/family1/22726c490fe44e599c03cb15c8e8fd1f as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family1/22726c490fe44e599c03cb15c8e8fd1f 2023-02-13 17:56:16,128 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family1/22726c490fe44e599c03cb15c8e8fd1f, entries=4, sequenceid=9, filesize=5.5 K 2023-02-13 17:56:16,129 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/.tmp/family2/fc7b23e79eb641f3ba7a435f02549ca4 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family2/fc7b23e79eb641f3ba7a435f02549ca4 2023-02-13 17:56:16,132 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family2/fc7b23e79eb641f3ba7a435f02549ca4, entries=2, sequenceid=9, filesize=5.1 K 2023-02-13 17:56:16,133 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for b2577b3a58833b8face4a64b8622245d in 1742ms, sequenceid=9, compaction requested=false 2023-02-13 17:56:16,133 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for b2577b3a58833b8face4a64b8622245d: 2023-02-13 17:56:16,133 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1676310970679.b2577b3a58833b8face4a64b8622245d. 2023-02-13 17:56:16,133 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 17:56:16,133 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 17:56:16,133 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:16,133 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-13 17:56:16,133 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-13 17:56:16,134 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 17:56:16,135 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:16,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:16,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:56:16,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:56:16,135 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 17:56:16,135 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:56:16,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:56:16,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:56:16,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 17:56:16,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:16,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:56:16,136 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-13 17:56:16,136 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7cada11d[Count = 0] remaining members to acquire global barrier 2023-02-13 17:56:16,136 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-13 17:56:16,136 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 17:56:16,138 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 17:56:16,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 17:56:16,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 17:56:16,138 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-13 17:56:16,138 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-13 17:56:16,138 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:56:16,138 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:16,138 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:56:16,139 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:16,139 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-13 17:56:16,139 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:56:16,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:16,139 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-13 17:56:16,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:56:16,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:56:16,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:56:16,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:56:16,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 17:56:16,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:16,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:56:16,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 17:56:16,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:16,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:56:16,142 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-13 17:56:16,142 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-13 17:56:16,142 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:56:16,142 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:56:16,142 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-13 17:56:16,142 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:56:16,143 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 17:56:16,143 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 17:56:16,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 17:56:16,143 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 17:56:16,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 17:56:16,143 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:16,143 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:56:16,144 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:56:16,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:56:16,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:56:16,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:56:16,144 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:16,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 17:56:16,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:56:16,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 17:56:16,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:56:16,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 17:56:16,146 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:16,146 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:56:16,146 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 17:56:16,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:56:16,147 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-13 17:56:16,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:56:16,147 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:56:16,146 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:56:16,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:56:16,147 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:56:16,147 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 17:56:16,147 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:16,147 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 17:56:16,147 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-13 17:56:16,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:56:16,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:56:16,147 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 17:56:16,147 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-02-13 17:56:16,147 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:56:16,147 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 17:56:16,247 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:56:16,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:56:16,249 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,,1676310970679.d32e83c04cf3e74b17ece5b86cf212fa. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 17:56:16,250 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,1,1676310970679.b2577b3a58833b8face4a64b8622245d. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 17:56:16,250 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,2,1676310970679.900ab85ad5988d481ec376125f462db9. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 17:56:16,251 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:56:16,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-02-13 17:56:16,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-13 17:56:16,253 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-13 17:56:16,253 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:56:16,253 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-13 17:56:16,253 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-13 17:56:16,254 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 17:56:16,254 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 17:56:16,256 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:56:16,256 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:16,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:56:16,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:56:16,256 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:16,256 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:56:16,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 17:56:16,256 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 17:56:16,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:56:16,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 17:56:16,257 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-13 17:56:16,257 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-02-13 17:56:16,257 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-13 17:56:16,257 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-13 17:56:16,257 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:56:16,257 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-13 17:56:16,257 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1676310970679.900ab85ad5988d481ec376125f462db9. 2023-02-13 17:56:16,257 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 17:56:16,257 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1676310970679.b2577b3a58833b8face4a64b8622245d. 2023-02-13 17:56:16,257 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1676310970679.d32e83c04cf3e74b17ece5b86cf212fa. 2023-02-13 17:56:16,257 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:56:16,257 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1676310970679.900ab85ad5988d481ec376125f462db9. started... 2023-02-13 17:56:16,258 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1676310970679.d32e83c04cf3e74b17ece5b86cf212fa. started... 2023-02-13 17:56:16,257 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1676310970679.b2577b3a58833b8face4a64b8622245d. started... 2023-02-13 17:56:16,258 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 900ab85ad5988d481ec376125f462db9 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-13 17:56:16,258 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing b2577b3a58833b8face4a64b8622245d 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-13 17:56:16,258 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing d32e83c04cf3e74b17ece5b86cf212fa 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-13 17:56:16,302 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213071f7e7b30ed4e0f887dbb29dcf6b729 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230213071f7e7b30ed4e0f887dbb29dcf6b729 2023-02-13 17:56:16,318 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302132000dd90d9d846fdb26c581ef08964fd to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302132000dd90d9d846fdb26c581ef08964fd 2023-02-13 17:56:16,322 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302134eeffa9a6fea46c8aa29ab171b29366c to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302134eeffa9a6fea46c8aa29ab171b29366c 2023-02-13 17:56:16,335 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/.tmp/family1/7088365570a74417808f024ff3618d86 2023-02-13 17:56:16,721 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/.tmp/family1/3cfe2d6fdfd0447d92738cd9c9b85e7d 2023-02-13 17:56:16,746 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/.tmp/family1/e7823b99b7af4f3aaeff028e4d84f892 2023-02-13 17:56:16,756 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213dadb13479cd54144960d168710cfe136 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230213dadb13479cd54144960d168710cfe136 2023-02-13 17:56:16,770 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021379fa2bc2aac1481b96d406b1e93fc678 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023021379fa2bc2aac1481b96d406b1e93fc678 2023-02-13 17:56:16,778 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213af6ad874d7a64f2e9e136025a50ba917 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230213af6ad874d7a64f2e9e136025a50ba917 2023-02-13 17:56:16,782 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/.tmp/family2/e7e1d3b6e89f411783b0312f74ec865d 2023-02-13 17:56:16,785 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/.tmp/family1/e7823b99b7af4f3aaeff028e4d84f892 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family1/e7823b99b7af4f3aaeff028e4d84f892 2023-02-13 17:56:16,807 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family1/e7823b99b7af4f3aaeff028e4d84f892, entries=4, sequenceid=13, filesize=5.5 K 2023-02-13 17:56:16,807 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/.tmp/family2/e7e1d3b6e89f411783b0312f74ec865d as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family2/e7e1d3b6e89f411783b0312f74ec865d 2023-02-13 17:56:16,810 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family2/e7e1d3b6e89f411783b0312f74ec865d, entries=2, sequenceid=13, filesize=5.1 K 2023-02-13 17:56:16,811 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 900ab85ad5988d481ec376125f462db9 in 553ms, sequenceid=13, compaction requested=true 2023-02-13 17:56:16,811 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 900ab85ad5988d481ec376125f462db9: 2023-02-13 17:56:16,811 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1676310970679.900ab85ad5988d481ec376125f462db9. 2023-02-13 17:56:16,811 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 17:56:17,160 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/.tmp/family2/dc3c526e4ccd494581c6b54780fa78c4 2023-02-13 17:56:17,164 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/.tmp/family1/3cfe2d6fdfd0447d92738cd9c9b85e7d as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family1/3cfe2d6fdfd0447d92738cd9c9b85e7d 2023-02-13 17:56:17,174 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/.tmp/family2/d833203654ad4eb285554112744fdd36 2023-02-13 17:56:17,178 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/.tmp/family1/7088365570a74417808f024ff3618d86 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family1/7088365570a74417808f024ff3618d86 2023-02-13 17:56:17,187 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family1/3cfe2d6fdfd0447d92738cd9c9b85e7d, entries=4, sequenceid=13, filesize=5.5 K 2023-02-13 17:56:17,188 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/.tmp/family2/dc3c526e4ccd494581c6b54780fa78c4 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family2/dc3c526e4ccd494581c6b54780fa78c4 2023-02-13 17:56:17,191 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family2/dc3c526e4ccd494581c6b54780fa78c4, entries=2, sequenceid=13, filesize=5.1 K 2023-02-13 17:56:17,191 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for d32e83c04cf3e74b17ece5b86cf212fa in 933ms, sequenceid=13, compaction requested=true 2023-02-13 17:56:17,192 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for d32e83c04cf3e74b17ece5b86cf212fa: 2023-02-13 17:56:17,192 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1676310970679.d32e83c04cf3e74b17ece5b86cf212fa. 2023-02-13 17:56:17,192 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 17:56:17,202 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family1/7088365570a74417808f024ff3618d86, entries=4, sequenceid=13, filesize=5.5 K 2023-02-13 17:56:17,203 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/.tmp/family2/d833203654ad4eb285554112744fdd36 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family2/d833203654ad4eb285554112744fdd36 2023-02-13 17:56:17,206 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family2/d833203654ad4eb285554112744fdd36, entries=2, sequenceid=13, filesize=5.1 K 2023-02-13 17:56:17,207 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for b2577b3a58833b8face4a64b8622245d in 949ms, sequenceid=13, compaction requested=true 2023-02-13 17:56:17,207 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for b2577b3a58833b8face4a64b8622245d: 2023-02-13 17:56:17,207 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1676310970679.b2577b3a58833b8face4a64b8622245d. 2023-02-13 17:56:17,207 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 17:56:17,207 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 17:56:17,207 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:17,207 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-13 17:56:17,207 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-13 17:56:17,208 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 17:56:17,208 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:17,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:17,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:56:17,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:56:17,209 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 17:56:17,209 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:56:17,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:56:17,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:56:17,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 17:56:17,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:17,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:56:17,210 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-13 17:56:17,210 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2b77ddcd[Count = 0] remaining members to acquire global barrier 2023-02-13 17:56:17,210 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-13 17:56:17,210 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 17:56:17,212 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 17:56:17,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 17:56:17,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 17:56:17,212 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-13 17:56:17,212 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-13 17:56:17,212 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:56:17,212 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:17,212 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:56:17,214 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:17,214 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-13 17:56:17,214 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:56:17,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:17,214 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-13 17:56:17,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:56:17,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:56:17,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:56:17,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:56:17,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 17:56:17,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:17,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:56:17,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 17:56:17,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:17,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:56:17,216 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-13 17:56:17,216 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-13 17:56:17,216 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:56:17,216 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:56:17,216 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-13 17:56:17,216 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:56:17,217 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 17:56:17,217 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 17:56:17,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 17:56:17,217 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:56:17,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 17:56:17,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 17:56:17,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:56:17,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:56:17,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:56:17,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:56:17,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:56:17,218 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:17,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 17:56:17,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 17:56:17,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:56:17,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 17:56:17,219 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:17,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:17,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:56:17,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 17:56:17,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:17,222 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:17,222 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:56:17,222 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 17:56:17,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:56:17,222 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-13 17:56:17,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:56:17,222 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:56:17,222 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:56:17,222 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-02-13 17:56:17,222 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:56:17,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:56:17,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:56:17,222 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 17:56:17,222 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:17,222 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-13 17:56:17,222 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:56:17,222 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 17:56:17,223 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 17:56:17,223 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 17:56:17,323 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:56:17,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:56:17,324 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,,1676310970679.d32e83c04cf3e74b17ece5b86cf212fa. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 17:56:17,325 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,1,1676310970679.b2577b3a58833b8face4a64b8622245d. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 17:56:17,325 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,2,1676310970679.900ab85ad5988d481ec376125f462db9. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 17:56:17,327 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:56:17,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-02-13 17:56:17,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-13 17:56:17,329 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-13 17:56:17,329 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:56:17,329 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-13 17:56:17,329 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-13 17:56:17,329 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 17:56:17,329 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 17:56:17,337 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:17,337 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:56:17,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:56:17,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:56:17,338 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:17,338 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:56:17,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 17:56:17,338 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 17:56:17,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:56:17,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 17:56:17,338 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-13 17:56:17,339 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-02-13 17:56:17,339 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-13 17:56:17,339 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-13 17:56:17,339 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:56:17,339 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-13 17:56:17,339 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1676310970679.900ab85ad5988d481ec376125f462db9. 2023-02-13 17:56:17,339 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 17:56:17,339 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1676310970679.900ab85ad5988d481ec376125f462db9. started... 2023-02-13 17:56:17,339 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1676310970679.d32e83c04cf3e74b17ece5b86cf212fa. 2023-02-13 17:56:17,339 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:56:17,339 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1676310970679.b2577b3a58833b8face4a64b8622245d. 2023-02-13 17:56:17,339 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 900ab85ad5988d481ec376125f462db9 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-13 17:56:17,339 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1676310970679.d32e83c04cf3e74b17ece5b86cf212fa. started... 2023-02-13 17:56:17,339 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1676310970679.b2577b3a58833b8face4a64b8622245d. started... 2023-02-13 17:56:17,340 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing d32e83c04cf3e74b17ece5b86cf212fa 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-13 17:56:17,340 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing b2577b3a58833b8face4a64b8622245d 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-13 17:56:17,389 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213d5b6c003275242c9a2631332f61ef9d9 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230213d5b6c003275242c9a2631332f61ef9d9 2023-02-13 17:56:17,392 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302133e80b4466f464746b6e95bb388a2eb6c to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302133e80b4466f464746b6e95bb388a2eb6c 2023-02-13 17:56:17,402 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 17:56:17,413 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/.tmp/family1/adaf74f994db4627b3ed8857e7d657ca 2023-02-13 17:56:17,447 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213de6b11b068474acfa276d5628b6c4662 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230213de6b11b068474acfa276d5628b6c4662 2023-02-13 17:56:17,793 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021311ccdb96bbf64d0793da398480fcf298 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023021311ccdb96bbf64d0793da398480fcf298 2023-02-13 17:56:17,814 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/.tmp/family1/99cdbcc1cabd42479347dfab933a5827 2023-02-13 17:56:17,852 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/.tmp/family2/14f00f978cc54e9395585f502b99a0d6 2023-02-13 17:56:17,855 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/.tmp/family1/adaf74f994db4627b3ed8857e7d657ca as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family1/adaf74f994db4627b3ed8857e7d657ca 2023-02-13 17:56:17,879 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family1/adaf74f994db4627b3ed8857e7d657ca, entries=4, sequenceid=17, filesize=5.5 K 2023-02-13 17:56:17,879 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/.tmp/family2/14f00f978cc54e9395585f502b99a0d6 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family2/14f00f978cc54e9395585f502b99a0d6 2023-02-13 17:56:17,883 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family2/14f00f978cc54e9395585f502b99a0d6, entries=2, sequenceid=17, filesize=5.1 K 2023-02-13 17:56:17,883 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 900ab85ad5988d481ec376125f462db9 in 544ms, sequenceid=17, compaction requested=true 2023-02-13 17:56:17,883 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 900ab85ad5988d481ec376125f462db9: 2023-02-13 17:56:17,883 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1676310970679.900ab85ad5988d481ec376125f462db9. 2023-02-13 17:56:17,884 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 17:56:18,208 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/.tmp/family1/0c4522f8b830479f9bf683f089ffee71 2023-02-13 17:56:18,253 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213f1f22929909944af9520df247feccc61 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230213f1f22929909944af9520df247feccc61 2023-02-13 17:56:18,640 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302132c92feb5d0634667bb7fba6b02011839 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202302132c92feb5d0634667bb7fba6b02011839 2023-02-13 17:56:18,657 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/.tmp/family2/3444bd68b87649c8b940dbc71cd1c5b3 2023-02-13 17:56:18,660 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/.tmp/family1/99cdbcc1cabd42479347dfab933a5827 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family1/99cdbcc1cabd42479347dfab933a5827 2023-02-13 17:56:18,683 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family1/99cdbcc1cabd42479347dfab933a5827, entries=4, sequenceid=17, filesize=5.5 K 2023-02-13 17:56:18,684 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/.tmp/family2/3444bd68b87649c8b940dbc71cd1c5b3 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family2/3444bd68b87649c8b940dbc71cd1c5b3 2023-02-13 17:56:18,688 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family2/3444bd68b87649c8b940dbc71cd1c5b3, entries=2, sequenceid=17, filesize=5.1 K 2023-02-13 17:56:18,688 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for d32e83c04cf3e74b17ece5b86cf212fa in 1348ms, sequenceid=17, compaction requested=true 2023-02-13 17:56:18,688 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for d32e83c04cf3e74b17ece5b86cf212fa: 2023-02-13 17:56:18,688 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1676310970679.d32e83c04cf3e74b17ece5b86cf212fa. 2023-02-13 17:56:18,688 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 17:56:19,045 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/.tmp/family2/982ecd4996cb4dd2baee2f8d34d94936 2023-02-13 17:56:19,049 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/.tmp/family1/0c4522f8b830479f9bf683f089ffee71 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family1/0c4522f8b830479f9bf683f089ffee71 2023-02-13 17:56:19,071 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family1/0c4522f8b830479f9bf683f089ffee71, entries=4, sequenceid=17, filesize=5.5 K 2023-02-13 17:56:19,072 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/.tmp/family2/982ecd4996cb4dd2baee2f8d34d94936 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family2/982ecd4996cb4dd2baee2f8d34d94936 2023-02-13 17:56:19,075 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family2/982ecd4996cb4dd2baee2f8d34d94936, entries=2, sequenceid=17, filesize=5.1 K 2023-02-13 17:56:19,076 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for b2577b3a58833b8face4a64b8622245d in 1736ms, sequenceid=17, compaction requested=true 2023-02-13 17:56:19,076 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for b2577b3a58833b8face4a64b8622245d: 2023-02-13 17:56:19,076 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1676310970679.b2577b3a58833b8face4a64b8622245d. 2023-02-13 17:56:19,076 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 17:56:19,076 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 17:56:19,076 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:19,076 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-13 17:56:19,076 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-13 17:56:19,078 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:19,078 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 17:56:19,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:19,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:56:19,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:56:19,078 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 17:56:19,078 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:56:19,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:56:19,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:56:19,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 17:56:19,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:19,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:56:19,080 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-13 17:56:19,080 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d5cff61[Count = 0] remaining members to acquire global barrier 2023-02-13 17:56:19,080 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-13 17:56:19,080 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 17:56:19,081 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 17:56:19,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 17:56:19,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 17:56:19,081 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-13 17:56:19,081 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-13 17:56:19,081 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:56:19,081 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:19,081 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:56:19,082 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:19,082 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-13 17:56:19,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:19,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:56:19,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:56:19,082 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:56:19,083 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-13 17:56:19,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:56:19,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:56:19,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 17:56:19,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:19,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:56:19,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 17:56:19,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:19,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:56:19,085 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-13 17:56:19,085 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-13 17:56:19,085 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:56:19,085 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:56:19,085 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-13 17:56:19,085 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:56:19,087 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 17:56:19,087 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 17:56:19,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 17:56:19,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:56:19,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:56:19,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 17:56:19,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 17:56:19,087 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:56:19,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:56:19,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:56:19,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:56:19,088 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:19,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 17:56:19,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 17:56:19,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:56:19,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 17:56:19,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:19,089 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:19,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:56:19,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 17:56:19,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:19,091 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:19,091 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:56:19,091 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 17:56:19,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:56:19,091 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-13 17:56:19,091 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:56:19,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:56:19,091 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 17:56:19,091 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:56:19,091 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:56:19,091 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:19,092 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 17:56:19,092 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 17:56:19,092 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-13 17:56:19,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:56:19,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:56:19,092 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 17:56:19,092 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:56:19,192 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:56:19,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:56:19,202 DEBUG [Listener at localhost/35343] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 17:56:19,209 DEBUG [Listener at localhost/35343] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 17:56:19,218 DEBUG [Listener at localhost/35343] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 17:56:19,219 DEBUG [Listener at localhost/35343] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 17:56:19,317 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 17:56:19,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-02-13 17:56:19,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-13 17:56:19,319 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-13 17:56:19,319 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:56:19,319 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-13 17:56:19,319 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-13 17:56:19,319 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 17:56:19,319 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 17:56:19,321 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:56:19,321 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:19,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:56:19,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:56:19,321 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:19,321 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 17:56:19,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 17:56:19,321 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 17:56:19,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 17:56:19,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 17:56:19,321 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-13 17:56:19,322 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-02-13 17:56:19,322 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-13 17:56:19,322 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-13 17:56:19,322 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 17:56:19,322 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-13 17:56:19,322 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1676310970679.900ab85ad5988d481ec376125f462db9. 2023-02-13 17:56:19,322 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 17:56:19,322 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1676310970679.d32e83c04cf3e74b17ece5b86cf212fa. 2023-02-13 17:56:19,322 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 17:56:19,322 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1676310970679.d32e83c04cf3e74b17ece5b86cf212fa. started... 2023-02-13 17:56:19,322 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1676310970679.b2577b3a58833b8face4a64b8622245d. 2023-02-13 17:56:19,322 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1676310970679.900ab85ad5988d481ec376125f462db9. started... 2023-02-13 17:56:19,322 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing d32e83c04cf3e74b17ece5b86cf212fa 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-13 17:56:19,322 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1676310970679.b2577b3a58833b8face4a64b8622245d. started... 2023-02-13 17:56:19,322 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 900ab85ad5988d481ec376125f462db9 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-13 17:56:19,322 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing b2577b3a58833b8face4a64b8622245d 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-13 17:56:19,364 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/.tmp/family1/5a1082c080084327af378969acc2819a 2023-02-13 17:56:19,364 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/.tmp/family1/d4cf1e2f3025451d9ffe997b0530063e 2023-02-13 17:56:19,387 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d4cf1e2f3025451d9ffe997b0530063e 2023-02-13 17:56:19,396 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/.tmp/family2/6d950a4928024fe584d4b3627faf5112 2023-02-13 17:56:19,398 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5a1082c080084327af378969acc2819a 2023-02-13 17:56:19,399 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6d950a4928024fe584d4b3627faf5112 2023-02-13 17:56:19,400 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/.tmp/family1/d4cf1e2f3025451d9ffe997b0530063e as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family1/d4cf1e2f3025451d9ffe997b0530063e 2023-02-13 17:56:19,434 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d4cf1e2f3025451d9ffe997b0530063e 2023-02-13 17:56:19,434 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family1/d4cf1e2f3025451d9ffe997b0530063e, entries=3, sequenceid=23, filesize=5.2 K 2023-02-13 17:56:19,435 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/.tmp/family2/6d950a4928024fe584d4b3627faf5112 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family2/6d950a4928024fe584d4b3627faf5112 2023-02-13 17:56:19,438 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6d950a4928024fe584d4b3627faf5112 2023-02-13 17:56:19,438 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family2/6d950a4928024fe584d4b3627faf5112, entries=1, sequenceid=23, filesize=5.0 K 2023-02-13 17:56:19,438 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for d32e83c04cf3e74b17ece5b86cf212fa in 116ms, sequenceid=23, compaction requested=true 2023-02-13 17:56:19,438 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for d32e83c04cf3e74b17ece5b86cf212fa: 2023-02-13 17:56:19,438 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1676310970679.d32e83c04cf3e74b17ece5b86cf212fa. 2023-02-13 17:56:19,438 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 17:56:20,177 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/.tmp/family1/96202997890743ed82cdc7d044553102 2023-02-13 17:56:20,200 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 96202997890743ed82cdc7d044553102 2023-02-13 17:56:20,208 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/.tmp/family2/76d64f34ca4c4ae9892ea60e888df5f2 2023-02-13 17:56:20,210 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 76d64f34ca4c4ae9892ea60e888df5f2 2023-02-13 17:56:20,211 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/.tmp/family1/5a1082c080084327af378969acc2819a as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family1/5a1082c080084327af378969acc2819a 2023-02-13 17:56:20,233 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5a1082c080084327af378969acc2819a 2023-02-13 17:56:20,233 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family1/5a1082c080084327af378969acc2819a, entries=3, sequenceid=23, filesize=5.2 K 2023-02-13 17:56:20,234 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/.tmp/family2/76d64f34ca4c4ae9892ea60e888df5f2 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family2/76d64f34ca4c4ae9892ea60e888df5f2 2023-02-13 17:56:20,237 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 76d64f34ca4c4ae9892ea60e888df5f2 2023-02-13 17:56:20,237 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family2/76d64f34ca4c4ae9892ea60e888df5f2, entries=1, sequenceid=23, filesize=5.0 K 2023-02-13 17:56:20,238 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 900ab85ad5988d481ec376125f462db9 in 916ms, sequenceid=23, compaction requested=true 2023-02-13 17:56:20,238 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 900ab85ad5988d481ec376125f462db9: 2023-02-13 17:56:20,238 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1676310970679.900ab85ad5988d481ec376125f462db9. 2023-02-13 17:56:20,238 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 17:56:21,011 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/.tmp/family2/12a7cfb94dd541ccb9073bb2b66028f7 2023-02-13 17:56:21,014 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 12a7cfb94dd541ccb9073bb2b66028f7 2023-02-13 17:56:21,015 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/.tmp/family1/96202997890743ed82cdc7d044553102 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family1/96202997890743ed82cdc7d044553102 2023-02-13 17:56:21,037 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 96202997890743ed82cdc7d044553102 2023-02-13 17:56:21,037 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family1/96202997890743ed82cdc7d044553102, entries=3, sequenceid=23, filesize=5.2 K 2023-02-13 17:56:21,038 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/.tmp/family2/12a7cfb94dd541ccb9073bb2b66028f7 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family2/12a7cfb94dd541ccb9073bb2b66028f7 2023-02-13 17:56:21,041 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 12a7cfb94dd541ccb9073bb2b66028f7 2023-02-13 17:56:21,041 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family2/12a7cfb94dd541ccb9073bb2b66028f7, entries=1, sequenceid=23, filesize=5.0 K 2023-02-13 17:56:21,042 INFO [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for b2577b3a58833b8face4a64b8622245d in 1720ms, sequenceid=23, compaction requested=true 2023-02-13 17:56:21,042 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for b2577b3a58833b8face4a64b8622245d: 2023-02-13 17:56:21,042 DEBUG [rs(jenkins-hbase4.apache.org,38881,1676310818035)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1676310970679.b2577b3a58833b8face4a64b8622245d. 2023-02-13 17:56:21,042 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 17:56:21,042 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 17:56:21,042 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:21,042 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-13 17:56:21,042 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-13 17:56:21,043 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 17:56:21,043 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:21,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:21,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:56:21,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:56:21,044 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 17:56:21,044 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 17:56:21,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:56:21,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:56:21,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 17:56:21,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:21,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:56:21,045 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1676310818035' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-13 17:56:21,045 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43087620[Count = 0] remaining members to acquire global barrier 2023-02-13 17:56:21,045 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-13 17:56:21,045 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 17:56:21,047 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 17:56:21,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 17:56:21,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 17:56:21,047 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-13 17:56:21,047 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-13 17:56:21,047 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,38881,1676310818035' in zk 2023-02-13 17:56:21,047 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:21,047 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 17:56:21,048 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:21,048 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-13 17:56:21,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:21,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:56:21,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:56:21,048 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:56:21,048 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1676310818035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-13 17:56:21,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:56:21,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:56:21,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 17:56:21,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:21,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:56:21,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 17:56:21,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:21,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,38881,1676310818035': 2023-02-13 17:56:21,050 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1676310818035' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-13 17:56:21,050 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-13 17:56:21,050 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 17:56:21,050 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 17:56:21,050 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-13 17:56:21,050 INFO [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 17:56:21,052 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 17:56:21,052 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 17:56:21,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 17:56:21,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 17:56:21,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 17:56:21,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 17:56:21,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 17:56:21,052 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:56:21,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 17:56:21,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:56:21,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:56:21,052 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:21,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 17:56:21,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 17:56:21,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 17:56:21,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 17:56:21,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:21,053 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:21,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 17:56:21,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 17:56:21,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:21,055 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:21,055 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 17:56:21,055 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 17:56:21,055 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:21,055 DEBUG [(jenkins-hbase4.apache.org,41433,1676310816814)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 17:56:21,055 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 17:56:21,055 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-13 17:56:21,055 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 17:56:21,055 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 17:56:21,055 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 17:56:21,055 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 17:56:21,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 17:56:21,056 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 17:56:21,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 17:56:21,056 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-13 17:56:21,056 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 17:56:21,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 17:56:21,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 17:56:21,156 DEBUG [Listener at localhost/35343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 17:56:21,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41433] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 17:56:21,157 DEBUG [Listener at localhost/35343] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 17:56:21,157 DEBUG [Listener at localhost/35343] regionserver.HStore(1912): 900ab85ad5988d481ec376125f462db9/family1 is initiating major compaction (all files) 2023-02-13 17:56:21,157 INFO [Listener at localhost/35343] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 17:56:21,157 INFO [Listener at localhost/35343] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 17:56:21,158 INFO [Listener at localhost/35343] regionserver.HRegion(2258): Starting compaction of 900ab85ad5988d481ec376125f462db9/family1 in testMajorCompactionFromAdmin,2,1676310970679.900ab85ad5988d481ec376125f462db9. 2023-02-13 17:56:21,158 INFO [Listener at localhost/35343] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family1/c4187737aab74e69a6286157637cb736, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family1/ebdcee67991c4580ad3e2eb9c35e906b, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family1/e7823b99b7af4f3aaeff028e4d84f892, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family1/adaf74f994db4627b3ed8857e7d657ca, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family1/5a1082c080084327af378969acc2819a] into tmpdir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/.tmp, totalSize=27.1 K 2023-02-13 17:56:21,158 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting c4187737aab74e69a6286157637cb736, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676310972834 2023-02-13 17:56:21,159 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting ebdcee67991c4580ad3e2eb9c35e906b, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676310974383 2023-02-13 17:56:21,159 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting e7823b99b7af4f3aaeff028e4d84f892, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676310976250 2023-02-13 17:56:21,159 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting adaf74f994db4627b3ed8857e7d657ca, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676310977325 2023-02-13 17:56:21,160 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting 5a1082c080084327af378969acc2819a, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-13 17:56:21,168 INFO [Listener at localhost/35343] throttle.PressureAwareThroughputController(145): 900ab85ad5988d481ec376125f462db9#family1#compaction#198 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 17:56:21,605 INFO [Listener at localhost/35343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230213ce67cb83e87b487582a4cb859af3ea6e_del 2023-02-13 17:56:21,605 INFO [Listener at localhost/35343] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213ce67cb83e87b487582a4cb859af3ea6e_del to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230213ce67cb83e87b487582a4cb859af3ea6e_del 2023-02-13 17:56:22,458 INFO [Listener at localhost/35343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 25936a8557b840fd9b11248af57a0b47 2023-02-13 17:56:22,458 DEBUG [Listener at localhost/35343] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/.tmp/family1/25936a8557b840fd9b11248af57a0b47 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family1/25936a8557b840fd9b11248af57a0b47 2023-02-13 17:56:22,481 INFO [Listener at localhost/35343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 25936a8557b840fd9b11248af57a0b47 2023-02-13 17:56:22,482 INFO [Listener at localhost/35343] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 900ab85ad5988d481ec376125f462db9/family1 of 900ab85ad5988d481ec376125f462db9 into 25936a8557b840fd9b11248af57a0b47(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 17:56:22,482 DEBUG [Listener at localhost/35343] regionserver.HRegion(2288): Compaction status journal for 900ab85ad5988d481ec376125f462db9: 2023-02-13 17:56:22,482 DEBUG [Listener at localhost/35343] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 17:56:22,483 DEBUG [Listener at localhost/35343] regionserver.HStore(1912): 900ab85ad5988d481ec376125f462db9/family2 is initiating major compaction (all files) 2023-02-13 17:56:22,483 INFO [Listener at localhost/35343] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 17:56:22,483 INFO [Listener at localhost/35343] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 17:56:22,483 INFO [Listener at localhost/35343] regionserver.HRegion(2258): Starting compaction of 900ab85ad5988d481ec376125f462db9/family2 in testMajorCompactionFromAdmin,2,1676310970679.900ab85ad5988d481ec376125f462db9. 2023-02-13 17:56:22,483 INFO [Listener at localhost/35343] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family2/8854f72cded240f0afa9f86796720d6c, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family2/1c99fde2cb784ca9b49b4882c15a790c, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family2/e7e1d3b6e89f411783b0312f74ec865d, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family2/14f00f978cc54e9395585f502b99a0d6, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family2/76d64f34ca4c4ae9892ea60e888df5f2] into tmpdir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/.tmp, totalSize=25.4 K 2023-02-13 17:56:22,484 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting 8854f72cded240f0afa9f86796720d6c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676310972834 2023-02-13 17:56:22,484 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting 1c99fde2cb784ca9b49b4882c15a790c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676310974383 2023-02-13 17:56:22,484 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting e7e1d3b6e89f411783b0312f74ec865d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676310976250 2023-02-13 17:56:22,485 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting 14f00f978cc54e9395585f502b99a0d6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676310977325 2023-02-13 17:56:22,485 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting 76d64f34ca4c4ae9892ea60e888df5f2, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-13 17:56:22,492 INFO [Listener at localhost/35343] throttle.PressureAwareThroughputController(145): 900ab85ad5988d481ec376125f462db9#family2#compaction#199 average throughput is 1.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 17:56:22,538 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family1/c4187737aab74e69a6286157637cb736, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family1/ebdcee67991c4580ad3e2eb9c35e906b, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family1/e7823b99b7af4f3aaeff028e4d84f892, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family1/adaf74f994db4627b3ed8857e7d657ca, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family1/5a1082c080084327af378969acc2819a] to archive 2023-02-13 17:56:22,539 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:56:22,541 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family1/c4187737aab74e69a6286157637cb736 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family1/c4187737aab74e69a6286157637cb736 2023-02-13 17:56:22,542 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family1/ebdcee67991c4580ad3e2eb9c35e906b to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family1/ebdcee67991c4580ad3e2eb9c35e906b 2023-02-13 17:56:22,543 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family1/e7823b99b7af4f3aaeff028e4d84f892 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family1/e7823b99b7af4f3aaeff028e4d84f892 2023-02-13 17:56:22,544 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family1/adaf74f994db4627b3ed8857e7d657ca to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family1/adaf74f994db4627b3ed8857e7d657ca 2023-02-13 17:56:22,545 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family1/5a1082c080084327af378969acc2819a to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family1/5a1082c080084327af378969acc2819a 2023-02-13 17:56:22,900 INFO [Listener at localhost/35343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202302132cf9bea151174d779b78639b0bf84f23_del 2023-02-13 17:56:22,901 INFO [Listener at localhost/35343] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302132cf9bea151174d779b78639b0bf84f23_del to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202302132cf9bea151174d779b78639b0bf84f23_del 2023-02-13 17:56:23,713 INFO [Listener at localhost/35343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 99d820c0f1f6448f9b35f6d86393b2d9 2023-02-13 17:56:23,714 DEBUG [Listener at localhost/35343] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/.tmp/family2/99d820c0f1f6448f9b35f6d86393b2d9 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family2/99d820c0f1f6448f9b35f6d86393b2d9 2023-02-13 17:56:23,719 INFO [Listener at localhost/35343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 99d820c0f1f6448f9b35f6d86393b2d9 2023-02-13 17:56:23,720 INFO [Listener at localhost/35343] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 900ab85ad5988d481ec376125f462db9/family2 of 900ab85ad5988d481ec376125f462db9 into 99d820c0f1f6448f9b35f6d86393b2d9(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 17:56:23,720 DEBUG [Listener at localhost/35343] regionserver.HRegion(2288): Compaction status journal for 900ab85ad5988d481ec376125f462db9: 2023-02-13 17:56:23,720 DEBUG [Listener at localhost/35343] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 17:56:23,720 DEBUG [Listener at localhost/35343] regionserver.HStore(1912): b2577b3a58833b8face4a64b8622245d/family1 is initiating major compaction (all files) 2023-02-13 17:56:23,721 INFO [Listener at localhost/35343] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 17:56:23,721 INFO [Listener at localhost/35343] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 17:56:23,723 INFO [Listener at localhost/35343] regionserver.HRegion(2258): Starting compaction of b2577b3a58833b8face4a64b8622245d/family1 in testMajorCompactionFromAdmin,1,1676310970679.b2577b3a58833b8face4a64b8622245d. 2023-02-13 17:56:23,723 INFO [Listener at localhost/35343] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family1/fd7399ba6a16483c9393d850baff72fb, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family1/22726c490fe44e599c03cb15c8e8fd1f, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family1/7088365570a74417808f024ff3618d86, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family1/0c4522f8b830479f9bf683f089ffee71, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family1/96202997890743ed82cdc7d044553102] into tmpdir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/.tmp, totalSize=27.1 K 2023-02-13 17:56:23,724 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting fd7399ba6a16483c9393d850baff72fb, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676310972834 2023-02-13 17:56:23,724 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting 22726c490fe44e599c03cb15c8e8fd1f, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676310974383 2023-02-13 17:56:23,724 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting 7088365570a74417808f024ff3618d86, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676310976250 2023-02-13 17:56:23,725 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting 0c4522f8b830479f9bf683f089ffee71, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676310977325 2023-02-13 17:56:23,725 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting 96202997890743ed82cdc7d044553102, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-13 17:56:23,736 INFO [Listener at localhost/35343] throttle.PressureAwareThroughputController(145): b2577b3a58833b8face4a64b8622245d#family1#compaction#200 average throughput is 0.43 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 17:56:23,738 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family2/8854f72cded240f0afa9f86796720d6c, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family2/1c99fde2cb784ca9b49b4882c15a790c, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family2/e7e1d3b6e89f411783b0312f74ec865d, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family2/14f00f978cc54e9395585f502b99a0d6, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family2/76d64f34ca4c4ae9892ea60e888df5f2] to archive 2023-02-13 17:56:23,739 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:56:23,740 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family2/8854f72cded240f0afa9f86796720d6c to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family2/8854f72cded240f0afa9f86796720d6c 2023-02-13 17:56:23,742 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family2/1c99fde2cb784ca9b49b4882c15a790c to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family2/1c99fde2cb784ca9b49b4882c15a790c 2023-02-13 17:56:23,743 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family2/e7e1d3b6e89f411783b0312f74ec865d to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family2/e7e1d3b6e89f411783b0312f74ec865d 2023-02-13 17:56:23,744 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family2/14f00f978cc54e9395585f502b99a0d6 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family2/14f00f978cc54e9395585f502b99a0d6 2023-02-13 17:56:23,746 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family2/76d64f34ca4c4ae9892ea60e888df5f2 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family2/76d64f34ca4c4ae9892ea60e888df5f2 2023-02-13 17:56:24,178 INFO [Listener at localhost/35343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230213af33160b4b724be09dc2c08ef7c880c9_del 2023-02-13 17:56:24,178 INFO [Listener at localhost/35343] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213af33160b4b724be09dc2c08ef7c880c9_del to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230213af33160b4b724be09dc2c08ef7c880c9_del 2023-02-13 17:56:25,033 INFO [Listener at localhost/35343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c3b36ccc4863450ea525408b098899dd 2023-02-13 17:56:25,034 DEBUG [Listener at localhost/35343] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/.tmp/family1/c3b36ccc4863450ea525408b098899dd as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family1/c3b36ccc4863450ea525408b098899dd 2023-02-13 17:56:25,056 INFO [Listener at localhost/35343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c3b36ccc4863450ea525408b098899dd 2023-02-13 17:56:25,057 INFO [Listener at localhost/35343] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in b2577b3a58833b8face4a64b8622245d/family1 of b2577b3a58833b8face4a64b8622245d into c3b36ccc4863450ea525408b098899dd(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 17:56:25,057 DEBUG [Listener at localhost/35343] regionserver.HRegion(2288): Compaction status journal for b2577b3a58833b8face4a64b8622245d: 2023-02-13 17:56:25,057 DEBUG [Listener at localhost/35343] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 17:56:25,057 DEBUG [Listener at localhost/35343] regionserver.HStore(1912): b2577b3a58833b8face4a64b8622245d/family2 is initiating major compaction (all files) 2023-02-13 17:56:25,058 INFO [Listener at localhost/35343] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 17:56:25,058 INFO [Listener at localhost/35343] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 17:56:25,058 INFO [Listener at localhost/35343] regionserver.HRegion(2258): Starting compaction of b2577b3a58833b8face4a64b8622245d/family2 in testMajorCompactionFromAdmin,1,1676310970679.b2577b3a58833b8face4a64b8622245d. 2023-02-13 17:56:25,058 INFO [Listener at localhost/35343] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family2/e098512c30c5437f9e842eeba18c568f, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family2/fc7b23e79eb641f3ba7a435f02549ca4, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family2/d833203654ad4eb285554112744fdd36, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family2/982ecd4996cb4dd2baee2f8d34d94936, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family2/12a7cfb94dd541ccb9073bb2b66028f7] into tmpdir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/.tmp, totalSize=25.4 K 2023-02-13 17:56:25,058 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting e098512c30c5437f9e842eeba18c568f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676310972834 2023-02-13 17:56:25,059 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting fc7b23e79eb641f3ba7a435f02549ca4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676310974383 2023-02-13 17:56:25,059 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting d833203654ad4eb285554112744fdd36, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676310976250 2023-02-13 17:56:25,059 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting 982ecd4996cb4dd2baee2f8d34d94936, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676310977325 2023-02-13 17:56:25,060 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting 12a7cfb94dd541ccb9073bb2b66028f7, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-13 17:56:25,067 INFO [Listener at localhost/35343] throttle.PressureAwareThroughputController(145): b2577b3a58833b8face4a64b8622245d#family2#compaction#201 average throughput is 1.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 17:56:25,137 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family1/fd7399ba6a16483c9393d850baff72fb, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family1/22726c490fe44e599c03cb15c8e8fd1f, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family1/7088365570a74417808f024ff3618d86, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family1/0c4522f8b830479f9bf683f089ffee71, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family1/96202997890743ed82cdc7d044553102] to archive 2023-02-13 17:56:25,138 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:56:25,139 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family1/fd7399ba6a16483c9393d850baff72fb to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family1/fd7399ba6a16483c9393d850baff72fb 2023-02-13 17:56:25,140 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family1/22726c490fe44e599c03cb15c8e8fd1f to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family1/22726c490fe44e599c03cb15c8e8fd1f 2023-02-13 17:56:25,141 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family1/7088365570a74417808f024ff3618d86 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family1/7088365570a74417808f024ff3618d86 2023-02-13 17:56:25,142 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family1/0c4522f8b830479f9bf683f089ffee71 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family1/0c4522f8b830479f9bf683f089ffee71 2023-02-13 17:56:25,143 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family1/96202997890743ed82cdc7d044553102 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family1/96202997890743ed82cdc7d044553102 2023-02-13 17:56:25,475 INFO [Listener at localhost/35343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230213276560532a714d73af2dedd8133dac56_del 2023-02-13 17:56:25,475 INFO [Listener at localhost/35343] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213276560532a714d73af2dedd8133dac56_del to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230213276560532a714d73af2dedd8133dac56_del 2023-02-13 17:56:26,288 INFO [Listener at localhost/35343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dc6b438ff29c4873a64046266aefe906 2023-02-13 17:56:26,289 DEBUG [Listener at localhost/35343] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/.tmp/family2/dc6b438ff29c4873a64046266aefe906 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family2/dc6b438ff29c4873a64046266aefe906 2023-02-13 17:56:26,292 INFO [Listener at localhost/35343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dc6b438ff29c4873a64046266aefe906 2023-02-13 17:56:26,293 INFO [Listener at localhost/35343] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in b2577b3a58833b8face4a64b8622245d/family2 of b2577b3a58833b8face4a64b8622245d into dc6b438ff29c4873a64046266aefe906(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 17:56:26,293 DEBUG [Listener at localhost/35343] regionserver.HRegion(2288): Compaction status journal for b2577b3a58833b8face4a64b8622245d: 2023-02-13 17:56:26,294 DEBUG [Listener at localhost/35343] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 17:56:26,294 DEBUG [Listener at localhost/35343] regionserver.HStore(1912): d32e83c04cf3e74b17ece5b86cf212fa/family1 is initiating major compaction (all files) 2023-02-13 17:56:26,294 INFO [Listener at localhost/35343] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 17:56:26,294 INFO [Listener at localhost/35343] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 17:56:26,295 INFO [Listener at localhost/35343] regionserver.HRegion(2258): Starting compaction of d32e83c04cf3e74b17ece5b86cf212fa/family1 in testMajorCompactionFromAdmin,,1676310970679.d32e83c04cf3e74b17ece5b86cf212fa. 2023-02-13 17:56:26,295 INFO [Listener at localhost/35343] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family1/aadba0868c7d4e798af24ee59d5ea0f7, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family1/30657e7f938e46eebfa343bcd44f15de, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family1/3cfe2d6fdfd0447d92738cd9c9b85e7d, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family1/99cdbcc1cabd42479347dfab933a5827, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family1/d4cf1e2f3025451d9ffe997b0530063e] into tmpdir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/.tmp, totalSize=27.1 K 2023-02-13 17:56:26,295 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting aadba0868c7d4e798af24ee59d5ea0f7, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676310972833 2023-02-13 17:56:26,296 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting 30657e7f938e46eebfa343bcd44f15de, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676310974383 2023-02-13 17:56:26,296 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting 3cfe2d6fdfd0447d92738cd9c9b85e7d, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676310976249 2023-02-13 17:56:26,297 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting 99cdbcc1cabd42479347dfab933a5827, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676310977324 2023-02-13 17:56:26,297 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting d4cf1e2f3025451d9ffe997b0530063e, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-13 17:56:26,305 INFO [Listener at localhost/35343] throttle.PressureAwareThroughputController(145): d32e83c04cf3e74b17ece5b86cf212fa#family1#compaction#202 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 17:56:26,337 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family2/e098512c30c5437f9e842eeba18c568f, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family2/fc7b23e79eb641f3ba7a435f02549ca4, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family2/d833203654ad4eb285554112744fdd36, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family2/982ecd4996cb4dd2baee2f8d34d94936, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family2/12a7cfb94dd541ccb9073bb2b66028f7] to archive 2023-02-13 17:56:26,338 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:56:26,340 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family2/e098512c30c5437f9e842eeba18c568f to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family2/e098512c30c5437f9e842eeba18c568f 2023-02-13 17:56:26,341 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family2/fc7b23e79eb641f3ba7a435f02549ca4 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family2/fc7b23e79eb641f3ba7a435f02549ca4 2023-02-13 17:56:26,342 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family2/d833203654ad4eb285554112744fdd36 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family2/d833203654ad4eb285554112744fdd36 2023-02-13 17:56:26,343 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family2/982ecd4996cb4dd2baee2f8d34d94936 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family2/982ecd4996cb4dd2baee2f8d34d94936 2023-02-13 17:56:26,343 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family2/12a7cfb94dd541ccb9073bb2b66028f7 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family2/12a7cfb94dd541ccb9073bb2b66028f7 2023-02-13 17:56:26,743 INFO [Listener at localhost/35343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202302130b502b5103764787b138ac24bac7ddfd_del 2023-02-13 17:56:26,743 INFO [Listener at localhost/35343] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302130b502b5103764787b138ac24bac7ddfd_del to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302130b502b5103764787b138ac24bac7ddfd_del 2023-02-13 17:56:27,607 INFO [Listener at localhost/35343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 26669f8d565b4a7dbbd24dff7bae6733 2023-02-13 17:56:27,608 DEBUG [Listener at localhost/35343] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/.tmp/family1/26669f8d565b4a7dbbd24dff7bae6733 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family1/26669f8d565b4a7dbbd24dff7bae6733 2023-02-13 17:56:27,631 INFO [Listener at localhost/35343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 26669f8d565b4a7dbbd24dff7bae6733 2023-02-13 17:56:27,632 INFO [Listener at localhost/35343] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in d32e83c04cf3e74b17ece5b86cf212fa/family1 of d32e83c04cf3e74b17ece5b86cf212fa into 26669f8d565b4a7dbbd24dff7bae6733(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 17:56:27,632 DEBUG [Listener at localhost/35343] regionserver.HRegion(2288): Compaction status journal for d32e83c04cf3e74b17ece5b86cf212fa: 2023-02-13 17:56:27,632 DEBUG [Listener at localhost/35343] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 17:56:27,633 DEBUG [Listener at localhost/35343] regionserver.HStore(1912): d32e83c04cf3e74b17ece5b86cf212fa/family2 is initiating major compaction (all files) 2023-02-13 17:56:27,633 INFO [Listener at localhost/35343] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 17:56:27,633 INFO [Listener at localhost/35343] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 17:56:27,633 INFO [Listener at localhost/35343] regionserver.HRegion(2258): Starting compaction of d32e83c04cf3e74b17ece5b86cf212fa/family2 in testMajorCompactionFromAdmin,,1676310970679.d32e83c04cf3e74b17ece5b86cf212fa. 2023-02-13 17:56:27,633 INFO [Listener at localhost/35343] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family2/1efe8648f8804b929b2bdb77e49c2706, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family2/5daf98fedc8e4332b464d2f5e538e901, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family2/dc3c526e4ccd494581c6b54780fa78c4, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family2/3444bd68b87649c8b940dbc71cd1c5b3, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family2/6d950a4928024fe584d4b3627faf5112] into tmpdir=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/.tmp, totalSize=25.4 K 2023-02-13 17:56:27,634 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting 1efe8648f8804b929b2bdb77e49c2706, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676310972833 2023-02-13 17:56:27,634 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting 5daf98fedc8e4332b464d2f5e538e901, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676310974383 2023-02-13 17:56:27,635 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting dc3c526e4ccd494581c6b54780fa78c4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676310976249 2023-02-13 17:56:27,635 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting 3444bd68b87649c8b940dbc71cd1c5b3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676310977324 2023-02-13 17:56:27,636 DEBUG [Listener at localhost/35343] compactions.Compactor(207): Compacting 6d950a4928024fe584d4b3627faf5112, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-13 17:56:27,637 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family1/aadba0868c7d4e798af24ee59d5ea0f7, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family1/30657e7f938e46eebfa343bcd44f15de, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family1/3cfe2d6fdfd0447d92738cd9c9b85e7d, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family1/99cdbcc1cabd42479347dfab933a5827, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family1/d4cf1e2f3025451d9ffe997b0530063e] to archive 2023-02-13 17:56:27,638 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:56:27,639 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family1/aadba0868c7d4e798af24ee59d5ea0f7 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family1/aadba0868c7d4e798af24ee59d5ea0f7 2023-02-13 17:56:27,640 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family1/30657e7f938e46eebfa343bcd44f15de to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family1/30657e7f938e46eebfa343bcd44f15de 2023-02-13 17:56:27,641 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family1/3cfe2d6fdfd0447d92738cd9c9b85e7d to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family1/3cfe2d6fdfd0447d92738cd9c9b85e7d 2023-02-13 17:56:27,642 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family1/99cdbcc1cabd42479347dfab933a5827 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family1/99cdbcc1cabd42479347dfab933a5827 2023-02-13 17:56:27,643 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family1/d4cf1e2f3025451d9ffe997b0530063e to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family1/d4cf1e2f3025451d9ffe997b0530063e 2023-02-13 17:56:27,645 INFO [Listener at localhost/35343] throttle.PressureAwareThroughputController(145): d32e83c04cf3e74b17ece5b86cf212fa#family2#compaction#203 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 17:56:28,053 INFO [Listener at localhost/35343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023021306a3c24abd514d668838a3e723aa7611_del 2023-02-13 17:56:28,053 INFO [Listener at localhost/35343] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021306a3c24abd514d668838a3e723aa7611_del to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e2023021306a3c24abd514d668838a3e723aa7611_del 2023-02-13 17:56:28,866 INFO [Listener at localhost/35343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for beb70f385820436997dcecad0420fb4b 2023-02-13 17:56:28,866 DEBUG [Listener at localhost/35343] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/.tmp/family2/beb70f385820436997dcecad0420fb4b as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family2/beb70f385820436997dcecad0420fb4b 2023-02-13 17:56:28,869 INFO [Listener at localhost/35343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for beb70f385820436997dcecad0420fb4b 2023-02-13 17:56:28,870 INFO [Listener at localhost/35343] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in d32e83c04cf3e74b17ece5b86cf212fa/family2 of d32e83c04cf3e74b17ece5b86cf212fa into beb70f385820436997dcecad0420fb4b(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 17:56:28,870 DEBUG [Listener at localhost/35343] regionserver.HRegion(2288): Compaction status journal for d32e83c04cf3e74b17ece5b86cf212fa: 2023-02-13 17:56:28,889 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 17:56:28,889 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x63de63fa to 127.0.0.1:64825 2023-02-13 17:56:28,889 DEBUG [Listener at localhost/35343] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 17:56:28,889 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 17:56:28,892 DEBUG [Listener at localhost/35343] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 17:56:28,895 DEBUG [Listener at localhost/35343] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 17:56:28,896 DEBUG [Listener at localhost/35343] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 17:56:28,900 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41433] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10,\xE9\x8D\x84y"Tt\xC0\xA0\x0Bx\x15\xF6\xD2\x99"\x10\x8D\xDE\xD5\x8D\xAAxc\xE3\x5C\x83\x0F'\xA2(\xDAk*\x10\xE4~\xDFx}\xE8\xB5C\xF4\xBF\xB9\xD2\xE5\xDEZ,2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testMajorCompactionFromAdmin 2023-02-13 17:56:28,921 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] procedure2.ProcedureExecutor(1029): Stored pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-02-13 17:56:28,922 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-02-13 17:56:28,922 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 17:56:28,922 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=123, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676311588922 2023-02-13 17:56:28,923 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-13 17:56:28,943 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family2/1efe8648f8804b929b2bdb77e49c2706, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family2/5daf98fedc8e4332b464d2f5e538e901, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family2/dc3c526e4ccd494581c6b54780fa78c4, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family2/3444bd68b87649c8b940dbc71cd1c5b3, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family2/6d950a4928024fe584d4b3627faf5112] to archive 2023-02-13 17:56:28,945 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:56:28,946 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family2/1efe8648f8804b929b2bdb77e49c2706 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family2/1efe8648f8804b929b2bdb77e49c2706 2023-02-13 17:56:28,948 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family2/5daf98fedc8e4332b464d2f5e538e901 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family2/5daf98fedc8e4332b464d2f5e538e901 2023-02-13 17:56:28,949 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family2/dc3c526e4ccd494581c6b54780fa78c4 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family2/dc3c526e4ccd494581c6b54780fa78c4 2023-02-13 17:56:28,951 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family2/3444bd68b87649c8b940dbc71cd1c5b3 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family2/3444bd68b87649c8b940dbc71cd1c5b3 2023-02-13 17:56:28,952 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family2/6d950a4928024fe584d4b3627faf5112 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family2/6d950a4928024fe584d4b3627faf5112 2023-02-13 17:56:29,117 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-02-13 17:56:29,252 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testMajorCompactionFromAdmin' and column 'family1' 2023-02-13 17:56:29,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202302130b502b5103764787b138ac24bac7ddfd_del 2023-02-13 17:56:29,296 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230213af33160b4b724be09dc2c08ef7c880c9_del 2023-02-13 17:56:29,318 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230213ce67cb83e87b487582a4cb859af3ea6e_del 2023-02-13 17:56:29,318 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testMajorCompactionFromAdmin' column='family1' 2023-02-13 17:56:29,318 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] zookeeper.ReadOnlyZKClient(139): Connect 0x6f7a786e to 127.0.0.1:64825 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 17:56:29,322 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@20b6260d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 17:56:29,323 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230213 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-13 17:56:29,885 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302130f993ff4fedc4f54bdf16e91058077c1 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302130f993ff4fedc4f54bdf16e91058077c1 2023-02-13 17:56:29,886 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230213 table='testMajorCompactionFromAdmin' column='family1' 2023-02-13 17:56:29,897 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 17:56:29,900 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49110, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 17:56:29,909 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 17:56:29,911 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60500, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 17:56:29,938 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230213/family1/e1ce518c1cbe4e61bb152ff8df577f47 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-02-13 17:56:29,939 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,1,1676310970679.b2577b3a58833b8face4a64b8622245d., hostname=jenkins-hbase4.apache.org,38881,1676310818035, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230213/family1/e1ce518c1cbe4e61bb152ff8df577f47}] 2023-02-13 17:56:29,944 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(763): Validating hfile at hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230213/family1/e1ce518c1cbe4e61bb152ff8df577f47 for inclusion in b2577b3a58833b8face4a64b8622245d/family1 2023-02-13 17:56:29,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-02-13 17:56:29,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(777): Region bounds: first=1 last=2 2023-02-13 17:56:29,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HRegion(2445): Flush status journal for b2577b3a58833b8face4a64b8622245d: 2023-02-13 17:56:29,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230213/family1/e1ce518c1cbe4e61bb152ff8df577f47 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionFromAdmin__9kvjvi6vj21fmp72ap9nrq3kvemg14ut8nrre8ltpc4h44b3vcg388cnk074jk30/family1/e1ce518c1cbe4e61bb152ff8df577f47 2023-02-13 17:56:29,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionFromAdmin__9kvjvi6vj21fmp72ap9nrq3kvemg14ut8nrre8ltpc4h44b3vcg388cnk074jk30/family1/e1ce518c1cbe4e61bb152ff8df577f47 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family1/a2ea23871afd4f0a916301a9ad460007_SeqId_28_ 2023-02-13 17:56:29,968 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(849): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionFromAdmin__9kvjvi6vj21fmp72ap9nrq3kvemg14ut8nrre8ltpc4h44b3vcg388cnk074jk30/family1/e1ce518c1cbe4e61bb152ff8df577f47 into b2577b3a58833b8face4a64b8622245d/family1 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family1/a2ea23871afd4f0a916301a9ad460007_SeqId_28_ - updating store file list. 2023-02-13 17:56:29,991 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(882): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family1/a2ea23871afd4f0a916301a9ad460007_SeqId_28_ into b2577b3a58833b8face4a64b8622245d/family1 2023-02-13 17:56:29,991 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(855): Successfully loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionFromAdmin__9kvjvi6vj21fmp72ap9nrq3kvemg14ut8nrre8ltpc4h44b3vcg388cnk074jk30/family1/e1ce518c1cbe4e61bb152ff8df577f47 into b2577b3a58833b8face4a64b8622245d/family1 (new location: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/family1/a2ea23871afd4f0a916301a9ad460007_SeqId_28_) 2023-02-13 17:56:29,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionFromAdmin__9kvjvi6vj21fmp72ap9nrq3kvemg14ut8nrre8ltpc4h44b3vcg388cnk074jk30/family1/e1ce518c1cbe4e61bb152ff8df577f47 2023-02-13 17:56:29,993 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230213 table='testMajorCompactionFromAdmin' column='family1' 2023-02-13 17:56:29,994 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:56:29,995 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023021311ccdb96bbf64d0793da398480fcf298 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023021311ccdb96bbf64d0793da398480fcf298 2023-02-13 17:56:29,996 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302132000dd90d9d846fdb26c581ef08964fd to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302132000dd90d9d846fdb26c581ef08964fd 2023-02-13 17:56:29,997 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302134256c087cf7b4e50a5d37b822418482f to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302134256c087cf7b4e50a5d37b822418482f 2023-02-13 17:56:29,998 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230213ac23b14948ab4a199ad883f3b33b6105 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230213ac23b14948ab4a199ad883f3b33b6105 2023-02-13 17:56:29,998 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-02-13 17:56:29,998 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230213' 2023-02-13 17:56:29,999 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230213 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-13 17:56:29,999 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230213 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-13 17:56:30,353 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-02-13 17:56:30,547 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302131ecf1e4f86b643119224ecaf57ecc11e to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302131ecf1e4f86b643119224ecaf57ecc11e 2023-02-13 17:56:30,547 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230213 table='testMajorCompactionFromAdmin' column='family1' 2023-02-13 17:56:30,600 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230213/family1/7fa4d3aed8054ec48ea6f32052bcbd27 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-02-13 17:56:30,601 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,2,1676310970679.900ab85ad5988d481ec376125f462db9., hostname=jenkins-hbase4.apache.org,38881,1676310818035, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230213/family1/7fa4d3aed8054ec48ea6f32052bcbd27}] 2023-02-13 17:56:30,603 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(763): Validating hfile at hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230213/family1/7fa4d3aed8054ec48ea6f32052bcbd27 for inclusion in 900ab85ad5988d481ec376125f462db9/family1 2023-02-13 17:56:30,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-02-13 17:56:30,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-13 17:56:30,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HRegion(2445): Flush status journal for 900ab85ad5988d481ec376125f462db9: 2023-02-13 17:56:30,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230213/family1/7fa4d3aed8054ec48ea6f32052bcbd27 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionFromAdmin__s3cv0cc2ses437agq48jiv60rgrp711rrn9d1mmc9dgofdeidgsrn4geu83f02jn/family1/7fa4d3aed8054ec48ea6f32052bcbd27 2023-02-13 17:56:30,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionFromAdmin__s3cv0cc2ses437agq48jiv60rgrp711rrn9d1mmc9dgofdeidgsrn4geu83f02jn/family1/7fa4d3aed8054ec48ea6f32052bcbd27 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family1/3a0538895865434a8a2e2379f1832326_SeqId_28_ 2023-02-13 17:56:30,639 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(849): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionFromAdmin__s3cv0cc2ses437agq48jiv60rgrp711rrn9d1mmc9dgofdeidgsrn4geu83f02jn/family1/7fa4d3aed8054ec48ea6f32052bcbd27 into 900ab85ad5988d481ec376125f462db9/family1 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family1/3a0538895865434a8a2e2379f1832326_SeqId_28_ - updating store file list. 2023-02-13 17:56:30,660 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(882): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family1/3a0538895865434a8a2e2379f1832326_SeqId_28_ into 900ab85ad5988d481ec376125f462db9/family1 2023-02-13 17:56:30,660 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(855): Successfully loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionFromAdmin__s3cv0cc2ses437agq48jiv60rgrp711rrn9d1mmc9dgofdeidgsrn4geu83f02jn/family1/7fa4d3aed8054ec48ea6f32052bcbd27 into 900ab85ad5988d481ec376125f462db9/family1 (new location: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/family1/3a0538895865434a8a2e2379f1832326_SeqId_28_) 2023-02-13 17:56:30,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionFromAdmin__s3cv0cc2ses437agq48jiv60rgrp711rrn9d1mmc9dgofdeidgsrn4geu83f02jn/family1/7fa4d3aed8054ec48ea6f32052bcbd27 2023-02-13 17:56:30,662 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230213 table='testMajorCompactionFromAdmin' column='family1' 2023-02-13 17:56:30,663 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:56:30,664 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302134eeffa9a6fea46c8aa29ab171b29366c to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302134eeffa9a6fea46c8aa29ab171b29366c 2023-02-13 17:56:30,665 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230213d57dd8f115ee459bb1103510aa2c2cfd to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230213d57dd8f115ee459bb1103510aa2c2cfd 2023-02-13 17:56:30,665 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230213d5b6c003275242c9a2631332f61ef9d9 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230213d5b6c003275242c9a2631332f61ef9d9 2023-02-13 17:56:30,666 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230213eef8c08f68124362b4af70ddb4b1284e to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230213eef8c08f68124362b4af70ddb4b1284e 2023-02-13 17:56:30,666 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-02-13 17:56:30,666 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230213' 2023-02-13 17:56:30,667 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230213 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-13 17:56:30,667 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230213 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-13 17:56:31,201 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-02-13 17:56:31,226 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021307a548b74cee4e7bb60bbf505a547d56 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023021307a548b74cee4e7bb60bbf505a547d56 2023-02-13 17:56:31,227 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230213 table='testMajorCompactionFromAdmin' column='family1' 2023-02-13 17:56:31,271 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230213/family1/cb30febbbbc14229b0a0e8cfbe7bbc97 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-02-13 17:56:31,272 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,,1676310970679.d32e83c04cf3e74b17ece5b86cf212fa., hostname=jenkins-hbase4.apache.org,38881,1676310818035, seqNum=2 for row with hfile group [{family1,hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230213/family1/cb30febbbbc14229b0a0e8cfbe7bbc97}] 2023-02-13 17:56:31,274 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(763): Validating hfile at hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230213/family1/cb30febbbbc14229b0a0e8cfbe7bbc97 for inclusion in d32e83c04cf3e74b17ece5b86cf212fa/family1 2023-02-13 17:56:31,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-02-13 17:56:31,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(777): Region bounds: first= last=1 2023-02-13 17:56:31,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HRegion(2445): Flush status journal for d32e83c04cf3e74b17ece5b86cf212fa: 2023-02-13 17:56:31,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230213/family1/cb30febbbbc14229b0a0e8cfbe7bbc97 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionFromAdmin__ipgjqf3nh9usnt21knotdllg0t2b44745h8srpo37nnjabq8g42lqv6movnue92d/family1/cb30febbbbc14229b0a0e8cfbe7bbc97 2023-02-13 17:56:31,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionFromAdmin__ipgjqf3nh9usnt21knotdllg0t2b44745h8srpo37nnjabq8g42lqv6movnue92d/family1/cb30febbbbc14229b0a0e8cfbe7bbc97 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family1/938cf662bfee4fe189f0d4db7c01cfaa_SeqId_28_ 2023-02-13 17:56:31,298 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(849): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionFromAdmin__ipgjqf3nh9usnt21knotdllg0t2b44745h8srpo37nnjabq8g42lqv6movnue92d/family1/cb30febbbbc14229b0a0e8cfbe7bbc97 into d32e83c04cf3e74b17ece5b86cf212fa/family1 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family1/938cf662bfee4fe189f0d4db7c01cfaa_SeqId_28_ - updating store file list. 2023-02-13 17:56:31,319 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(882): Loaded HFile hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family1/938cf662bfee4fe189f0d4db7c01cfaa_SeqId_28_ into d32e83c04cf3e74b17ece5b86cf212fa/family1 2023-02-13 17:56:31,319 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.HStore(855): Successfully loaded hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionFromAdmin__ipgjqf3nh9usnt21knotdllg0t2b44745h8srpo37nnjabq8g42lqv6movnue92d/family1/cb30febbbbc14229b0a0e8cfbe7bbc97 into d32e83c04cf3e74b17ece5b86cf212fa/family1 (new location: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/family1/938cf662bfee4fe189f0d4db7c01cfaa_SeqId_28_) 2023-02-13 17:56:31,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38881] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/staging/jenkins__testMajorCompactionFromAdmin__ipgjqf3nh9usnt21knotdllg0t2b44745h8srpo37nnjabq8g42lqv6movnue92d/family1/cb30febbbbc14229b0a0e8cfbe7bbc97 2023-02-13 17:56:31,321 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230213 table='testMajorCompactionFromAdmin' column='family1' 2023-02-13 17:56:31,322 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:56:31,323 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230213071f7e7b30ed4e0f887dbb29dcf6b729 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230213071f7e7b30ed4e0f887dbb29dcf6b729 2023-02-13 17:56:31,324 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230213108b47d2400e4e808a890b9338cbb62f to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230213108b47d2400e4e808a890b9338cbb62f 2023-02-13 17:56:31,325 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302133e80b4466f464746b6e95bb388a2eb6c to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302133e80b4466f464746b6e95bb388a2eb6c 2023-02-13 17:56:31,326 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023021362c8760a56ae4072b056c3ee35af93c1 to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023021362c8760a56ae4072b056c3ee35af93c1 2023-02-13 17:56:31,326 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-02-13 17:56:31,326 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230213' 2023-02-13 17:56:31,326 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230213 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-13 17:56:31,326 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testMajorCompactionFromAdmin' column='family1' 2023-02-13 17:56:31,327 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-13 17:56:31,327 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] compactions.PartitionedMobCompactor(367): [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302130b502b5103764787b138ac24bac7ddfd_del] 2023-02-13 17:56:31,327 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:56:31,328 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302130b502b5103764787b138ac24bac7ddfd_del to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302130b502b5103764787b138ac24bac7ddfd_del 2023-02-13 17:56:31,328 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-02-13 17:56:31,328 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] compactions.PartitionedMobCompactor(367): [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230213af33160b4b724be09dc2c08ef7c880c9_del] 2023-02-13 17:56:31,328 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:56:31,329 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230213af33160b4b724be09dc2c08ef7c880c9_del to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230213af33160b4b724be09dc2c08ef7c880c9_del 2023-02-13 17:56:31,329 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-02-13 17:56:31,329 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] compactions.PartitionedMobCompactor(367): [hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230213ce67cb83e87b487582a4cb859af3ea6e_del] 2023-02-13 17:56:31,329 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 17:56:31,330 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230213ce67cb83e87b487582a4cb859af3ea6e_del to hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230213ce67cb83e87b487582a4cb859af3ea6e_del 2023-02-13 17:56:31,330 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-02-13 17:56:31,330 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676310821404] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 17:56:31,331 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=123, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-02-13 17:56:31,333 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=123, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE in 2.4110 sec 2023-02-13 17:56:31,348 DEBUG [Listener at localhost/35343] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 17:56:31,350 DEBUG [Listener at localhost/35343] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 17:56:31,352 DEBUG [Listener at localhost/35343] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 17:56:31,353 DEBUG [Listener at localhost/35343] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 17:56:31,357 INFO [Listener at localhost/35343] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 17:56:31,390 INFO [Listener at localhost/35343] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=247 (was 253), OpenFileDescriptor=624 (was 639), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=124 (was 122) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=1107 (was 773) - AvailableMemoryMB LEAK? - 2023-02-13 17:56:31,390 DEBUG [Listener at localhost/35343] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x47652242 to 127.0.0.1:64825 2023-02-13 17:56:31,390 DEBUG [Listener at localhost/35343] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 17:56:31,391 INFO [Listener at localhost/35343] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-13 17:56:31,391 INFO [Listener at localhost/35343] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 17:56:31,391 DEBUG [Listener at localhost/35343] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5759ba4d to 127.0.0.1:64825 2023-02-13 17:56:31,391 DEBUG [Listener at localhost/35343] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 17:56:31,391 DEBUG [Listener at localhost/35343] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-13 17:56:31,391 DEBUG [Listener at localhost/35343] util.JVMClusterUtil(257): Found active master hash=559599870, stopped=false 2023-02-13 17:56:31,391 INFO [Listener at localhost/35343] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,41433,1676310816814 2023-02-13 17:56:31,393 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 17:56:31,393 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 17:56:31,393 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 17:56:31,393 INFO [Listener at localhost/35343] procedure2.ProcedureExecutor(629): Stopping 2023-02-13 17:56:31,393 DEBUG [Listener at localhost/35343] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6d5aa146 to 127.0.0.1:64825 2023-02-13 17:56:31,393 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 17:56:31,393 DEBUG [Listener at localhost/35343] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 17:56:31,393 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 17:56:31,394 INFO [Listener at localhost/35343] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,38881,1676310818035' ***** 2023-02-13 17:56:31,394 INFO [Listener at localhost/35343] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 17:56:31,394 INFO [RS:0;jenkins-hbase4:38881] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 17:56:31,394 INFO [RS:0;jenkins-hbase4:38881] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 17:56:31,394 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 17:56:31,394 INFO [RS:0;jenkins-hbase4:38881] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 17:56:31,394 INFO [RS:0;jenkins-hbase4:38881] regionserver.HRegionServer(3304): Received CLOSE for f19921593afbd7b00a7e7155a8bb7bf1 2023-02-13 17:56:31,395 INFO [RS:0;jenkins-hbase4:38881] regionserver.HRegionServer(3304): Received CLOSE for 900ab85ad5988d481ec376125f462db9 2023-02-13 17:56:31,395 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing f19921593afbd7b00a7e7155a8bb7bf1, disabling compactions & flushes 2023-02-13 17:56:31,395 INFO [RS:0;jenkins-hbase4:38881] regionserver.HRegionServer(3304): Received CLOSE for c963ca8c1a0836a4d54901641d03d8f9 2023-02-13 17:56:31,395 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyPolicy,,1676310867011.f19921593afbd7b00a7e7155a8bb7bf1. 2023-02-13 17:56:31,395 INFO [RS:0;jenkins-hbase4:38881] regionserver.HRegionServer(3304): Received CLOSE for 0cfde756752436e731853466f9c70810 2023-02-13 17:56:31,395 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1676310867011.f19921593afbd7b00a7e7155a8bb7bf1. 2023-02-13 17:56:31,395 INFO [RS:0;jenkins-hbase4:38881] regionserver.HRegionServer(3304): Received CLOSE for d8c03018eab4e6ef28148efb7a566098 2023-02-13 17:56:31,395 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1676310867011.f19921593afbd7b00a7e7155a8bb7bf1. after waiting 0 ms 2023-02-13 17:56:31,395 INFO [RS:0;jenkins-hbase4:38881] regionserver.HRegionServer(3304): Received CLOSE for feb7d9eaf104f779ab1be2f45a76a113 2023-02-13 17:56:31,395 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1676310867011.f19921593afbd7b00a7e7155a8bb7bf1. 2023-02-13 17:56:31,395 INFO [RS:0;jenkins-hbase4:38881] regionserver.HRegionServer(3304): Received CLOSE for 31ed0c2af7cdd1dd637af92056b0a735 2023-02-13 17:56:31,395 INFO [RS:0;jenkins-hbase4:38881] regionserver.HRegionServer(3304): Received CLOSE for 226b4a6bd1e102bd425b4fe5fa7b9927 2023-02-13 17:56:31,395 INFO [RS:0;jenkins-hbase4:38881] regionserver.HRegionServer(3304): Received CLOSE for ac0d738464f62c71a828e94f1b2c219e 2023-02-13 17:56:31,396 INFO [RS:0;jenkins-hbase4:38881] regionserver.HRegionServer(3304): Received CLOSE for e0bf4ad0d89965bdcd22d3ba4d2aebf8 2023-02-13 17:56:31,396 INFO [RS:0;jenkins-hbase4:38881] regionserver.HRegionServer(3304): Received CLOSE for 09a1ec58cf507f489c469b2ff2ea7e37 2023-02-13 17:56:31,396 INFO [RS:0;jenkins-hbase4:38881] regionserver.HRegionServer(3304): Received CLOSE for b2577b3a58833b8face4a64b8622245d 2023-02-13 17:56:31,396 INFO [RS:0;jenkins-hbase4:38881] regionserver.HRegionServer(3304): Received CLOSE for 0e77f96cde768bcde1fba587339782c6 2023-02-13 17:56:31,396 INFO [RS:0;jenkins-hbase4:38881] regionserver.HRegionServer(3304): Received CLOSE for 62b401dbb0accf13145c5bbf2c490411 2023-02-13 17:56:31,396 INFO [RS:0;jenkins-hbase4:38881] regionserver.HRegionServer(3304): Received CLOSE for d32e83c04cf3e74b17ece5b86cf212fa 2023-02-13 17:56:31,396 INFO [RS:0;jenkins-hbase4:38881] regionserver.HRegionServer(3304): Received CLOSE for 7ec577192744923b1bb4fd6145642689 2023-02-13 17:56:31,396 INFO [RS:0;jenkins-hbase4:38881] regionserver.HRegionServer(3304): Received CLOSE for e21ab587bd90d22ef3de7b8eb89e7b53 2023-02-13 17:56:31,396 INFO [RS:0;jenkins-hbase4:38881] regionserver.HRegionServer(3304): Received CLOSE for bb026d2891c65ad4947af9cdbd2aee81 2023-02-13 17:56:31,396 INFO [RS:0;jenkins-hbase4:38881] regionserver.HRegionServer(3304): Received CLOSE for 3100400af58d7bf345cc01ad0d304911 2023-02-13 17:56:31,396 INFO [RS:0;jenkins-hbase4:38881] regionserver.HRegionServer(3304): Received CLOSE for 78541a6966cb9a690d8fb6a7bfe8fd0a 2023-02-13 17:56:31,396 INFO [RS:0;jenkins-hbase4:38881] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:31,396 DEBUG [RS:0;jenkins-hbase4:38881] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x07d5cf0e to 127.0.0.1:64825 2023-02-13 17:56:31,396 DEBUG [RS:0;jenkins-hbase4:38881] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 17:56:31,396 INFO [RS:0;jenkins-hbase4:38881] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 17:56:31,396 INFO [RS:0;jenkins-hbase4:38881] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 17:56:31,396 INFO [RS:0;jenkins-hbase4:38881] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 17:56:31,397 INFO [RS:0;jenkins-hbase4:38881] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-13 17:56:31,397 INFO [RS:0;jenkins-hbase4:38881] regionserver.HRegionServer(1475): Waiting on 21 regions to close 2023-02-13 17:56:31,397 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 17:56:31,397 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 17:56:31,397 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 17:56:31,397 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 17:56:31,397 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 17:56:31,397 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=50.56 KB heapSize=78.23 KB 2023-02-13 17:56:31,398 DEBUG [RS:0;jenkins-hbase4:38881] regionserver.HRegionServer(1505): Waiting on 09a1ec58cf507f489c469b2ff2ea7e37, 0cfde756752436e731853466f9c70810, 0e77f96cde768bcde1fba587339782c6, 1588230740, 226b4a6bd1e102bd425b4fe5fa7b9927, 3100400af58d7bf345cc01ad0d304911, 31ed0c2af7cdd1dd637af92056b0a735, 62b401dbb0accf13145c5bbf2c490411, 78541a6966cb9a690d8fb6a7bfe8fd0a, 7ec577192744923b1bb4fd6145642689, 900ab85ad5988d481ec376125f462db9, ac0d738464f62c71a828e94f1b2c219e, b2577b3a58833b8face4a64b8622245d, bb026d2891c65ad4947af9cdbd2aee81, c963ca8c1a0836a4d54901641d03d8f9, d32e83c04cf3e74b17ece5b86cf212fa, d8c03018eab4e6ef28148efb7a566098, e0bf4ad0d89965bdcd22d3ba4d2aebf8, e21ab587bd90d22ef3de7b8eb89e7b53, f19921593afbd7b00a7e7155a8bb7bf1, feb7d9eaf104f779ab1be2f45a76a113 2023-02-13 17:56:31,399 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyPolicy/f19921593afbd7b00a7e7155a8bb7bf1/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-13 17:56:31,400 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyPolicy,,1676310867011.f19921593afbd7b00a7e7155a8bb7bf1. 2023-02-13 17:56:31,400 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for f19921593afbd7b00a7e7155a8bb7bf1: Waiting for close lock at 1676310991395Running coprocessor pre-close hooks at 1676310991395Disabling compacts and flushes for region at 1676310991395Disabling writes for close at 1676310991395Writing region close event to WAL at 1676310991396 (+1 ms)Running coprocessor post-close hooks at 1676310991399 (+3 ms)Closed at 1676310991400 (+1 ms) 2023-02-13 17:56:31,400 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyPolicy,,1676310867011.f19921593afbd7b00a7e7155a8bb7bf1. 2023-02-13 17:56:31,400 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 900ab85ad5988d481ec376125f462db9, disabling compactions & flushes 2023-02-13 17:56:31,400 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,2,1676310970679.900ab85ad5988d481ec376125f462db9. 2023-02-13 17:56:31,400 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1676310970679.900ab85ad5988d481ec376125f462db9. 2023-02-13 17:56:31,400 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,2,1676310970679.900ab85ad5988d481ec376125f462db9. after waiting 0 ms 2023-02-13 17:56:31,400 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,2,1676310970679.900ab85ad5988d481ec376125f462db9. 2023-02-13 17:56:31,403 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/900ab85ad5988d481ec376125f462db9/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-13 17:56:31,404 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,2,1676310970679.900ab85ad5988d481ec376125f462db9. 2023-02-13 17:56:31,404 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 900ab85ad5988d481ec376125f462db9: Waiting for close lock at 1676310991400Running coprocessor pre-close hooks at 1676310991400Disabling compacts and flushes for region at 1676310991400Disabling writes for close at 1676310991400Writing region close event to WAL at 1676310991401 (+1 ms)Running coprocessor post-close hooks at 1676310991404 (+3 ms)Closed at 1676310991404 2023-02-13 17:56:31,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,2,1676310970679.900ab85ad5988d481ec376125f462db9. 2023-02-13 17:56:31,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c963ca8c1a0836a4d54901641d03d8f9, disabling compactions & flushes 2023-02-13 17:56:31,405 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9. 2023-02-13 17:56:31,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9. 2023-02-13 17:56:31,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9. after waiting 0 ms 2023-02-13 17:56:31,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9. 2023-02-13 17:56:31,407 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c963ca8c1a0836a4d54901641d03d8f9/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-02-13 17:56:31,408 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9. 2023-02-13 17:56:31,408 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c963ca8c1a0836a4d54901641d03d8f9: Waiting for close lock at 1676310991405Running coprocessor pre-close hooks at 1676310991405Disabling compacts and flushes for region at 1676310991405Disabling writes for close at 1676310991405Writing region close event to WAL at 1676310991406 (+1 ms)Running coprocessor post-close hooks at 1676310991408 (+2 ms)Closed at 1676310991408 2023-02-13 17:56:31,408 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676310877715.c963ca8c1a0836a4d54901641d03d8f9. 2023-02-13 17:56:31,408 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 0cfde756752436e731853466f9c70810, disabling compactions & flushes 2023-02-13 17:56:31,408 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithMonthlyPolicy,,1676310835316.0cfde756752436e731853466f9c70810. 2023-02-13 17:56:31,408 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1676310835316.0cfde756752436e731853466f9c70810. 2023-02-13 17:56:31,408 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1676310835316.0cfde756752436e731853466f9c70810. after waiting 0 ms 2023-02-13 17:56:31,409 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1676310835316.0cfde756752436e731853466f9c70810. 2023-02-13 17:56:31,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithMonthlyPolicy/0cfde756752436e731853466f9c70810/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-02-13 17:56:31,412 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithMonthlyPolicy,,1676310835316.0cfde756752436e731853466f9c70810. 2023-02-13 17:56:31,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 0cfde756752436e731853466f9c70810: Waiting for close lock at 1676310991408Running coprocessor pre-close hooks at 1676310991408Disabling compacts and flushes for region at 1676310991408Disabling writes for close at 1676310991409 (+1 ms)Writing region close event to WAL at 1676310991409Running coprocessor post-close hooks at 1676310991411 (+2 ms)Closed at 1676310991412 (+1 ms) 2023-02-13 17:56:31,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithMonthlyPolicy,,1676310835316.0cfde756752436e731853466f9c70810. 2023-02-13 17:56:31,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing d8c03018eab4e6ef28148efb7a566098, disabling compactions & flushes 2023-02-13 17:56:31,412 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,2,1676310862672.d8c03018eab4e6ef28148efb7a566098. 2023-02-13 17:56:31,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1676310862672.d8c03018eab4e6ef28148efb7a566098. 2023-02-13 17:56:31,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1676310862672.d8c03018eab4e6ef28148efb7a566098. after waiting 0 ms 2023-02-13 17:56:31,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1676310862672.d8c03018eab4e6ef28148efb7a566098. 2023-02-13 17:56:31,414 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testScannerOnBulkLoadRefHFiles/d8c03018eab4e6ef28148efb7a566098/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-02-13 17:56:31,415 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,2,1676310862672.d8c03018eab4e6ef28148efb7a566098. 2023-02-13 17:56:31,415 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for d8c03018eab4e6ef28148efb7a566098: Waiting for close lock at 1676310991412Running coprocessor pre-close hooks at 1676310991412Disabling compacts and flushes for region at 1676310991412Disabling writes for close at 1676310991412Writing region close event to WAL at 1676310991412Running coprocessor post-close hooks at 1676310991414 (+2 ms)Closed at 1676310991415 (+1 ms) 2023-02-13 17:56:31,415 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,2,1676310862672.d8c03018eab4e6ef28148efb7a566098. 2023-02-13 17:56:31,415 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing feb7d9eaf104f779ab1be2f45a76a113, disabling compactions & flushes 2023-02-13 17:56:31,415 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113. 2023-02-13 17:56:31,415 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113. 2023-02-13 17:56:31,415 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113. after waiting 0 ms 2023-02-13 17:56:31,415 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113. 2023-02-13 17:56:31,418 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/feb7d9eaf104f779ab1be2f45a76a113/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-02-13 17:56:31,418 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113. 2023-02-13 17:56:31,418 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for feb7d9eaf104f779ab1be2f45a76a113: Waiting for close lock at 1676310991415Running coprocessor pre-close hooks at 1676310991415Disabling compacts and flushes for region at 1676310991415Disabling writes for close at 1676310991415Writing region close event to WAL at 1676310991416 (+1 ms)Running coprocessor post-close hooks at 1676310991418 (+2 ms)Closed at 1676310991418 2023-02-13 17:56:31,418 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,2,1676310915655.feb7d9eaf104f779ab1be2f45a76a113. 2023-02-13 17:56:31,419 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 31ed0c2af7cdd1dd637af92056b0a735, disabling compactions & flushes 2023-02-13 17:56:31,419 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735. 2023-02-13 17:56:31,419 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735. 2023-02-13 17:56:31,419 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735. after waiting 0 ms 2023-02-13 17:56:31,419 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735. 2023-02-13 17:56:31,421 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/31ed0c2af7cdd1dd637af92056b0a735/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-02-13 17:56:31,422 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735. 2023-02-13 17:56:31,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 31ed0c2af7cdd1dd637af92056b0a735: Waiting for close lock at 1676310991419Running coprocessor pre-close hooks at 1676310991419Disabling compacts and flushes for region at 1676310991419Disabling writes for close at 1676310991419Writing region close event to WAL at 1676310991419Running coprocessor post-close hooks at 1676310991422 (+3 ms)Closed at 1676310991422 2023-02-13 17:56:31,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676310893378.31ed0c2af7cdd1dd637af92056b0a735. 2023-02-13 17:56:31,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 226b4a6bd1e102bd425b4fe5fa7b9927, disabling compactions & flushes 2023-02-13 17:56:31,422 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,1,1676310940745.226b4a6bd1e102bd425b4fe5fa7b9927. 2023-02-13 17:56:31,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,1,1676310940745.226b4a6bd1e102bd425b4fe5fa7b9927. 2023-02-13 17:56:31,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,1,1676310940745.226b4a6bd1e102bd425b4fe5fa7b9927. after waiting 0 ms 2023-02-13 17:56:31,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,1,1676310940745.226b4a6bd1e102bd425b4fe5fa7b9927. 2023-02-13 17:56:31,425 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/226b4a6bd1e102bd425b4fe5fa7b9927/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-13 17:56:31,426 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed ns:testMinorCompaction,1,1676310940745.226b4a6bd1e102bd425b4fe5fa7b9927. 2023-02-13 17:56:31,426 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 226b4a6bd1e102bd425b4fe5fa7b9927: Waiting for close lock at 1676310991422Running coprocessor pre-close hooks at 1676310991422Disabling compacts and flushes for region at 1676310991422Disabling writes for close at 1676310991422Writing region close event to WAL at 1676310991423 (+1 ms)Running coprocessor post-close hooks at 1676310991426 (+3 ms)Closed at 1676310991426 2023-02-13 17:56:31,426 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,1,1676310940745.226b4a6bd1e102bd425b4fe5fa7b9927. 2023-02-13 17:56:31,426 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ac0d738464f62c71a828e94f1b2c219e, disabling compactions & flushes 2023-02-13 17:56:31,426 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,1,1676310862672.ac0d738464f62c71a828e94f1b2c219e. 2023-02-13 17:56:31,427 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1676310862672.ac0d738464f62c71a828e94f1b2c219e. 2023-02-13 17:56:31,427 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1676310862672.ac0d738464f62c71a828e94f1b2c219e. after waiting 0 ms 2023-02-13 17:56:31,427 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1676310862672.ac0d738464f62c71a828e94f1b2c219e. 2023-02-13 17:56:31,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testScannerOnBulkLoadRefHFiles/ac0d738464f62c71a828e94f1b2c219e/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-13 17:56:31,430 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,1,1676310862672.ac0d738464f62c71a828e94f1b2c219e. 2023-02-13 17:56:31,430 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ac0d738464f62c71a828e94f1b2c219e: Waiting for close lock at 1676310991426Running coprocessor pre-close hooks at 1676310991426Disabling compacts and flushes for region at 1676310991426Disabling writes for close at 1676310991427 (+1 ms)Writing region close event to WAL at 1676310991427Running coprocessor post-close hooks at 1676310991429 (+2 ms)Closed at 1676310991430 (+1 ms) 2023-02-13 17:56:31,430 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,1,1676310862672.ac0d738464f62c71a828e94f1b2c219e. 2023-02-13 17:56:31,430 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e0bf4ad0d89965bdcd22d3ba4d2aebf8, disabling compactions & flushes 2023-02-13 17:56:31,430 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMinorCompactionWithWeeklyPolicy,,1676310849244.e0bf4ad0d89965bdcd22d3ba4d2aebf8. 2023-02-13 17:56:31,430 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1676310849244.e0bf4ad0d89965bdcd22d3ba4d2aebf8. 2023-02-13 17:56:31,430 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1676310849244.e0bf4ad0d89965bdcd22d3ba4d2aebf8. after waiting 0 ms 2023-02-13 17:56:31,430 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1676310849244.e0bf4ad0d89965bdcd22d3ba4d2aebf8. 2023-02-13 17:56:31,432 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithWeeklyPolicy/e0bf4ad0d89965bdcd22d3ba4d2aebf8/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-13 17:56:31,433 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMinorCompactionWithWeeklyPolicy,,1676310849244.e0bf4ad0d89965bdcd22d3ba4d2aebf8. 2023-02-13 17:56:31,433 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e0bf4ad0d89965bdcd22d3ba4d2aebf8: Waiting for close lock at 1676310991430Running coprocessor pre-close hooks at 1676310991430Disabling compacts and flushes for region at 1676310991430Disabling writes for close at 1676310991430Writing region close event to WAL at 1676310991430Running coprocessor post-close hooks at 1676310991433 (+3 ms)Closed at 1676310991433 2023-02-13 17:56:31,433 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithWeeklyPolicy,,1676310849244.e0bf4ad0d89965bdcd22d3ba4d2aebf8. 2023-02-13 17:56:31,433 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 09a1ec58cf507f489c469b2ff2ea7e37, disabling compactions & flushes 2023-02-13 17:56:31,433 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMinorCompactionWithMonthlyPolicy,,1676310958628.09a1ec58cf507f489c469b2ff2ea7e37. 2023-02-13 17:56:31,433 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1676310958628.09a1ec58cf507f489c469b2ff2ea7e37. 2023-02-13 17:56:31,433 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1676310958628.09a1ec58cf507f489c469b2ff2ea7e37. after waiting 0 ms 2023-02-13 17:56:31,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1676310958628.09a1ec58cf507f489c469b2ff2ea7e37. 2023-02-13 17:56:31,436 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMinorCompactionWithMonthlyPolicy/09a1ec58cf507f489c469b2ff2ea7e37/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-02-13 17:56:31,436 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-02-13 17:56:31,437 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMinorCompactionWithMonthlyPolicy,,1676310958628.09a1ec58cf507f489c469b2ff2ea7e37. 2023-02-13 17:56:31,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 09a1ec58cf507f489c469b2ff2ea7e37: Waiting for close lock at 1676310991433Running coprocessor pre-close hooks at 1676310991433Disabling compacts and flushes for region at 1676310991433Disabling writes for close at 1676310991434 (+1 ms)Writing region close event to WAL at 1676310991434Running coprocessor post-close hooks at 1676310991437 (+3 ms)Closed at 1676310991437 2023-02-13 17:56:31,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithMonthlyPolicy,,1676310958628.09a1ec58cf507f489c469b2ff2ea7e37. 2023-02-13 17:56:31,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing b2577b3a58833b8face4a64b8622245d, disabling compactions & flushes 2023-02-13 17:56:31,437 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,1,1676310970679.b2577b3a58833b8face4a64b8622245d. 2023-02-13 17:56:31,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1676310970679.b2577b3a58833b8face4a64b8622245d. 2023-02-13 17:56:31,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,1,1676310970679.b2577b3a58833b8face4a64b8622245d. after waiting 0 ms 2023-02-13 17:56:31,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,1,1676310970679.b2577b3a58833b8face4a64b8622245d. 2023-02-13 17:56:31,440 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/b2577b3a58833b8face4a64b8622245d/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-13 17:56:31,440 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,1,1676310970679.b2577b3a58833b8face4a64b8622245d. 2023-02-13 17:56:31,440 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for b2577b3a58833b8face4a64b8622245d: Waiting for close lock at 1676310991437Running coprocessor pre-close hooks at 1676310991437Disabling compacts and flushes for region at 1676310991437Disabling writes for close at 1676310991437Writing region close event to WAL at 1676310991438 (+1 ms)Running coprocessor post-close hooks at 1676310991440 (+2 ms)Closed at 1676310991440 2023-02-13 17:56:31,441 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,1,1676310970679.b2577b3a58833b8face4a64b8622245d. 2023-02-13 17:56:31,441 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 0e77f96cde768bcde1fba587339782c6, disabling compactions & flushes 2023-02-13 17:56:31,441 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,,1676310940745.0e77f96cde768bcde1fba587339782c6. 2023-02-13 17:56:31,441 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,,1676310940745.0e77f96cde768bcde1fba587339782c6. 2023-02-13 17:56:31,441 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,,1676310940745.0e77f96cde768bcde1fba587339782c6. after waiting 0 ms 2023-02-13 17:56:31,441 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,,1676310940745.0e77f96cde768bcde1fba587339782c6. 2023-02-13 17:56:31,444 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/0e77f96cde768bcde1fba587339782c6/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-13 17:56:31,446 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed ns:testMinorCompaction,,1676310940745.0e77f96cde768bcde1fba587339782c6. 2023-02-13 17:56:31,446 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 0e77f96cde768bcde1fba587339782c6: Waiting for close lock at 1676310991441Running coprocessor pre-close hooks at 1676310991441Disabling compacts and flushes for region at 1676310991441Disabling writes for close at 1676310991441Writing region close event to WAL at 1676310991442 (+1 ms)Running coprocessor post-close hooks at 1676310991444 (+2 ms)Closed at 1676310991446 (+2 ms) 2023-02-13 17:56:31,446 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,,1676310940745.0e77f96cde768bcde1fba587339782c6. 2023-02-13 17:56:31,446 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 62b401dbb0accf13145c5bbf2c490411, disabling compactions & flushes 2023-02-13 17:56:31,446 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676310820366.62b401dbb0accf13145c5bbf2c490411. 2023-02-13 17:56:31,446 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676310820366.62b401dbb0accf13145c5bbf2c490411. 2023-02-13 17:56:31,446 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676310820366.62b401dbb0accf13145c5bbf2c490411. after waiting 0 ms 2023-02-13 17:56:31,446 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676310820366.62b401dbb0accf13145c5bbf2c490411. 2023-02-13 17:56:31,446 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 62b401dbb0accf13145c5bbf2c490411 1/1 column families, dataSize=109 B heapSize=592 B 2023-02-13 17:56:31,491 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 17:56:31,598 DEBUG [RS:0;jenkins-hbase4:38881] regionserver.HRegionServer(1505): Waiting on 1588230740, 3100400af58d7bf345cc01ad0d304911, 62b401dbb0accf13145c5bbf2c490411, 78541a6966cb9a690d8fb6a7bfe8fd0a, 7ec577192744923b1bb4fd6145642689, bb026d2891c65ad4947af9cdbd2aee81, d32e83c04cf3e74b17ece5b86cf212fa, e21ab587bd90d22ef3de7b8eb89e7b53 2023-02-13 17:56:31,798 DEBUG [RS:0;jenkins-hbase4:38881] regionserver.HRegionServer(1505): Waiting on 1588230740, 3100400af58d7bf345cc01ad0d304911, 62b401dbb0accf13145c5bbf2c490411, 78541a6966cb9a690d8fb6a7bfe8fd0a, 7ec577192744923b1bb4fd6145642689, bb026d2891c65ad4947af9cdbd2aee81, d32e83c04cf3e74b17ece5b86cf212fa, e21ab587bd90d22ef3de7b8eb89e7b53 2023-02-13 17:56:31,807 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48.28 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/hbase/meta/1588230740/.tmp/info/cbc3dc6f045a4c91b9c1fe629d5a06da 2023-02-13 17:56:31,811 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cbc3dc6f045a4c91b9c1fe629d5a06da 2023-02-13 17:56:31,862 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=109 B at sequenceid=7 (bloomFilter=true), to=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/hbase/namespace/62b401dbb0accf13145c5bbf2c490411/.tmp/info/e1c48f9771aa45b2800b995428e246ce 2023-02-13 17:56:31,867 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/hbase/namespace/62b401dbb0accf13145c5bbf2c490411/.tmp/info/e1c48f9771aa45b2800b995428e246ce as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/hbase/namespace/62b401dbb0accf13145c5bbf2c490411/info/e1c48f9771aa45b2800b995428e246ce 2023-02-13 17:56:31,870 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/hbase/namespace/62b401dbb0accf13145c5bbf2c490411/info/e1c48f9771aa45b2800b995428e246ce, entries=3, sequenceid=7, filesize=4.8 K 2023-02-13 17:56:31,871 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for 62b401dbb0accf13145c5bbf2c490411 in 425ms, sequenceid=7, compaction requested=false 2023-02-13 17:56:31,874 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/hbase/namespace/62b401dbb0accf13145c5bbf2c490411/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=1 2023-02-13 17:56:31,875 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676310820366.62b401dbb0accf13145c5bbf2c490411. 2023-02-13 17:56:31,875 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 62b401dbb0accf13145c5bbf2c490411: Waiting for close lock at 1676310991446Running coprocessor pre-close hooks at 1676310991446Disabling compacts and flushes for region at 1676310991446Disabling writes for close at 1676310991446Obtaining lock to block concurrent updates at 1676310991446Preparing flush snapshotting stores in 62b401dbb0accf13145c5bbf2c490411 at 1676310991446Finished memstore snapshotting hbase:namespace,,1676310820366.62b401dbb0accf13145c5bbf2c490411., syncing WAL and waiting on mvcc, flushsize=dataSize=109, getHeapSize=576, getOffHeapSize=0, getCellsCount=3 at 1676310991446Flushing stores of hbase:namespace,,1676310820366.62b401dbb0accf13145c5bbf2c490411. at 1676310991447 (+1 ms)Flushing 62b401dbb0accf13145c5bbf2c490411/info: creating writer at 1676310991447Flushing 62b401dbb0accf13145c5bbf2c490411/info: appending metadata at 1676310991449 (+2 ms)Flushing 62b401dbb0accf13145c5bbf2c490411/info: closing flushed file at 1676310991449Flushing 62b401dbb0accf13145c5bbf2c490411/info: reopening flushed file at 1676310991867 (+418 ms)Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for 62b401dbb0accf13145c5bbf2c490411 in 425ms, sequenceid=7, compaction requested=false at 1676310991871 (+4 ms)Writing region close event to WAL at 1676310991872 (+1 ms)Running coprocessor post-close hooks at 1676310991875 (+3 ms)Closed at 1676310991875 2023-02-13 17:56:31,875 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676310820366.62b401dbb0accf13145c5bbf2c490411. 2023-02-13 17:56:31,875 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing d32e83c04cf3e74b17ece5b86cf212fa, disabling compactions & flushes 2023-02-13 17:56:31,875 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,,1676310970679.d32e83c04cf3e74b17ece5b86cf212fa. 2023-02-13 17:56:31,875 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1676310970679.d32e83c04cf3e74b17ece5b86cf212fa. 2023-02-13 17:56:31,875 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,,1676310970679.d32e83c04cf3e74b17ece5b86cf212fa. after waiting 0 ms 2023-02-13 17:56:31,875 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,,1676310970679.d32e83c04cf3e74b17ece5b86cf212fa. 2023-02-13 17:56:31,878 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionFromAdmin/d32e83c04cf3e74b17ece5b86cf212fa/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-13 17:56:31,878 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,,1676310970679.d32e83c04cf3e74b17ece5b86cf212fa. 2023-02-13 17:56:31,878 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for d32e83c04cf3e74b17ece5b86cf212fa: Waiting for close lock at 1676310991875Running coprocessor pre-close hooks at 1676310991875Disabling compacts and flushes for region at 1676310991875Disabling writes for close at 1676310991875Writing region close event to WAL at 1676310991876 (+1 ms)Running coprocessor post-close hooks at 1676310991878 (+2 ms)Closed at 1676310991878 2023-02-13 17:56:31,878 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,,1676310970679.d32e83c04cf3e74b17ece5b86cf212fa. 2023-02-13 17:56:31,878 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 7ec577192744923b1bb4fd6145642689, disabling compactions & flushes 2023-02-13 17:56:31,878 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,2,1676310940745.7ec577192744923b1bb4fd6145642689. 2023-02-13 17:56:31,878 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,2,1676310940745.7ec577192744923b1bb4fd6145642689. 2023-02-13 17:56:31,878 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,2,1676310940745.7ec577192744923b1bb4fd6145642689. after waiting 0 ms 2023-02-13 17:56:31,878 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,2,1676310940745.7ec577192744923b1bb4fd6145642689. 2023-02-13 17:56:31,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/ns/testMinorCompaction/7ec577192744923b1bb4fd6145642689/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-13 17:56:31,881 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed ns:testMinorCompaction,2,1676310940745.7ec577192744923b1bb4fd6145642689. 2023-02-13 17:56:31,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 7ec577192744923b1bb4fd6145642689: Waiting for close lock at 1676310991878Running coprocessor pre-close hooks at 1676310991878Disabling compacts and flushes for region at 1676310991878Disabling writes for close at 1676310991878Writing region close event to WAL at 1676310991879 (+1 ms)Running coprocessor post-close hooks at 1676310991881 (+2 ms)Closed at 1676310991881 2023-02-13 17:56:31,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,2,1676310940745.7ec577192744923b1bb4fd6145642689. 2023-02-13 17:56:31,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e21ab587bd90d22ef3de7b8eb89e7b53, disabling compactions & flushes 2023-02-13 17:56:31,881 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,,1676310862672.e21ab587bd90d22ef3de7b8eb89e7b53. 2023-02-13 17:56:31,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1676310862672.e21ab587bd90d22ef3de7b8eb89e7b53. 2023-02-13 17:56:31,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1676310862672.e21ab587bd90d22ef3de7b8eb89e7b53. after waiting 0 ms 2023-02-13 17:56:31,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1676310862672.e21ab587bd90d22ef3de7b8eb89e7b53. 2023-02-13 17:56:31,883 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testScannerOnBulkLoadRefHFiles/e21ab587bd90d22ef3de7b8eb89e7b53/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-13 17:56:31,884 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,,1676310862672.e21ab587bd90d22ef3de7b8eb89e7b53. 2023-02-13 17:56:31,884 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e21ab587bd90d22ef3de7b8eb89e7b53: Waiting for close lock at 1676310991881Running coprocessor pre-close hooks at 1676310991881Disabling compacts and flushes for region at 1676310991881Disabling writes for close at 1676310991881Writing region close event to WAL at 1676310991882 (+1 ms)Running coprocessor post-close hooks at 1676310991884 (+2 ms)Closed at 1676310991884 2023-02-13 17:56:31,884 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,,1676310862672.e21ab587bd90d22ef3de7b8eb89e7b53. 2023-02-13 17:56:31,884 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing bb026d2891c65ad4947af9cdbd2aee81, disabling compactions & flushes 2023-02-13 17:56:31,884 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81. 2023-02-13 17:56:31,884 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81. 2023-02-13 17:56:31,884 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81. after waiting 0 ms 2023-02-13 17:56:31,884 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81. 2023-02-13 17:56:31,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/bb026d2891c65ad4947af9cdbd2aee81/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-02-13 17:56:31,887 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81. 2023-02-13 17:56:31,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for bb026d2891c65ad4947af9cdbd2aee81: Waiting for close lock at 1676310991884Running coprocessor pre-close hooks at 1676310991884Disabling compacts and flushes for region at 1676310991884Disabling writes for close at 1676310991884Writing region close event to WAL at 1676310991885 (+1 ms)Running coprocessor post-close hooks at 1676310991887 (+2 ms)Closed at 1676310991887 2023-02-13 17:56:31,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,1,1676310915655.bb026d2891c65ad4947af9cdbd2aee81. 2023-02-13 17:56:31,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3100400af58d7bf345cc01ad0d304911, disabling compactions & flushes 2023-02-13 17:56:31,887 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911. 2023-02-13 17:56:31,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911. 2023-02-13 17:56:31,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911. after waiting 0 ms 2023-02-13 17:56:31,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911. 2023-02-13 17:56:31,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testCompactionWithHFileLink/3100400af58d7bf345cc01ad0d304911/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-02-13 17:56:31,890 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911. 2023-02-13 17:56:31,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3100400af58d7bf345cc01ad0d304911: Waiting for close lock at 1676310991887Running coprocessor pre-close hooks at 1676310991887Disabling compacts and flushes for region at 1676310991887Disabling writes for close at 1676310991887Writing region close event to WAL at 1676310991888 (+1 ms)Running coprocessor post-close hooks at 1676310991890 (+2 ms)Closed at 1676310991890 2023-02-13 17:56:31,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,,1676310915655.3100400af58d7bf345cc01ad0d304911. 2023-02-13 17:56:31,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 78541a6966cb9a690d8fb6a7bfe8fd0a, disabling compactions & flushes 2023-02-13 17:56:31,890 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a. 2023-02-13 17:56:31,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a. 2023-02-13 17:56:31,891 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a. after waiting 0 ms 2023-02-13 17:56:31,891 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a. 2023-02-13 17:56:31,893 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/78541a6966cb9a690d8fb6a7bfe8fd0a/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-02-13 17:56:31,893 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a. 2023-02-13 17:56:31,893 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 78541a6966cb9a690d8fb6a7bfe8fd0a: Waiting for close lock at 1676310991890Running coprocessor pre-close hooks at 1676310991890Disabling compacts and flushes for region at 1676310991890Disabling writes for close at 1676310991891 (+1 ms)Writing region close event to WAL at 1676310991891Running coprocessor post-close hooks at 1676310991893 (+2 ms)Closed at 1676310991893 2023-02-13 17:56:31,893 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1676310821592.78541a6966cb9a690d8fb6a7bfe8fd0a. 2023-02-13 17:56:31,998 DEBUG [RS:0;jenkins-hbase4:38881] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-13 17:56:32,199 DEBUG [RS:0;jenkins-hbase4:38881] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-13 17:56:32,217 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=102 B at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/hbase/meta/1588230740/.tmp/rep_barrier/d7edeb9b98494958bcce1b49555d7ba8 2023-02-13 17:56:32,220 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d7edeb9b98494958bcce1b49555d7ba8 2023-02-13 17:56:32,360 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-13 17:56:32,360 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-13 17:56:32,399 INFO [RS:0;jenkins-hbase4:38881] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-13 17:56:32,399 DEBUG [RS:0;jenkins-hbase4:38881] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-13 17:56:32,399 DEBUG [RS:0;jenkins-hbase4:38881] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-13 17:56:32,437 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-02-13 17:56:32,599 DEBUG [RS:0;jenkins-hbase4:38881] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-13 17:56:32,627 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.18 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/hbase/meta/1588230740/.tmp/table/a9c50646197949169cad061454bf98af 2023-02-13 17:56:32,630 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a9c50646197949169cad061454bf98af 2023-02-13 17:56:32,630 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/hbase/meta/1588230740/.tmp/info/cbc3dc6f045a4c91b9c1fe629d5a06da as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/hbase/meta/1588230740/info/cbc3dc6f045a4c91b9c1fe629d5a06da 2023-02-13 17:56:32,633 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cbc3dc6f045a4c91b9c1fe629d5a06da 2023-02-13 17:56:32,633 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/hbase/meta/1588230740/info/cbc3dc6f045a4c91b9c1fe629d5a06da, entries=226, sequenceid=130, filesize=37.9 K 2023-02-13 17:56:32,634 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/hbase/meta/1588230740/.tmp/rep_barrier/d7edeb9b98494958bcce1b49555d7ba8 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/hbase/meta/1588230740/rep_barrier/d7edeb9b98494958bcce1b49555d7ba8 2023-02-13 17:56:32,638 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d7edeb9b98494958bcce1b49555d7ba8 2023-02-13 17:56:32,638 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/hbase/meta/1588230740/rep_barrier/d7edeb9b98494958bcce1b49555d7ba8, entries=1, sequenceid=130, filesize=5.0 K 2023-02-13 17:56:32,638 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/hbase/meta/1588230740/.tmp/table/a9c50646197949169cad061454bf98af as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/hbase/meta/1588230740/table/a9c50646197949169cad061454bf98af 2023-02-13 17:56:32,642 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a9c50646197949169cad061454bf98af 2023-02-13 17:56:32,642 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/hbase/meta/1588230740/table/a9c50646197949169cad061454bf98af, entries=27, sequenceid=130, filesize=6.6 K 2023-02-13 17:56:32,644 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~50.56 KB/51772, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 1247ms, sequenceid=130, compaction requested=false 2023-02-13 17:56:32,647 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/data/hbase/meta/1588230740/recovered.edits/133.seqid, newMaxSeqId=133, maxSeqId=1 2023-02-13 17:56:32,648 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-13 17:56:32,648 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 17:56:32,648 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676310991397Running coprocessor pre-close hooks at 1676310991397Disabling compacts and flushes for region at 1676310991397Disabling writes for close at 1676310991397Obtaining lock to block concurrent updates at 1676310991397Preparing flush snapshotting stores in 1588230740 at 1676310991397Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=51772, getHeapSize=80064, getOffHeapSize=0, getCellsCount=365 at 1676310991397Flushing stores of hbase:meta,,1.1588230740 at 1676310991398 (+1 ms)Flushing 1588230740/info: creating writer at 1676310991398Flushing 1588230740/info: appending metadata at 1676310991402 (+4 ms)Flushing 1588230740/info: closing flushed file at 1676310991402Flushing 1588230740/rep_barrier: creating writer at 1676310991811 (+409 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676310991813 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676310991813Flushing 1588230740/table: creating writer at 1676310992220 (+407 ms)Flushing 1588230740/table: appending metadata at 1676310992222 (+2 ms)Flushing 1588230740/table: closing flushed file at 1676310992222Flushing 1588230740/info: reopening flushed file at 1676310992631 (+409 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676310992634 (+3 ms)Flushing 1588230740/table: reopening flushed file at 1676310992639 (+5 ms)Finished flush of dataSize ~50.56 KB/51772, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 1247ms, sequenceid=130, compaction requested=false at 1676310992644 (+5 ms)Writing region close event to WAL at 1676310992645 (+1 ms)Running coprocessor post-close hooks at 1676310992648 (+3 ms)Closed at 1676310992648 2023-02-13 17:56:32,648 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-13 17:56:32,799 INFO [RS:0;jenkins-hbase4:38881] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,38881,1676310818035; all regions closed. 2023-02-13 17:56:32,806 DEBUG [RS:0;jenkins-hbase4:38881] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/oldWALs 2023-02-13 17:56:32,806 INFO [RS:0;jenkins-hbase4:38881] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38881%2C1676310818035.meta:.meta(num 1676310820103) 2023-02-13 17:56:32,810 DEBUG [RS:0;jenkins-hbase4:38881] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/oldWALs 2023-02-13 17:56:32,810 INFO [RS:0;jenkins-hbase4:38881] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38881%2C1676310818035:(num 1676310819513) 2023-02-13 17:56:32,810 DEBUG [RS:0;jenkins-hbase4:38881] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 17:56:32,810 INFO [RS:0;jenkins-hbase4:38881] regionserver.LeaseManager(133): Closed leases 2023-02-13 17:56:32,810 INFO [RS:0;jenkins-hbase4:38881] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-13 17:56:32,811 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 17:56:32,811 INFO [RS:0;jenkins-hbase4:38881] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38881 2023-02-13 17:56:32,820 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38881,1676310818035 2023-02-13 17:56:32,820 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 17:56:32,820 ERROR [Listener at localhost/35343-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6d0ee661 rejected from java.util.concurrent.ThreadPoolExecutor@69317f18[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 531] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 17:56:32,821 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 17:56:32,821 ERROR [Listener at localhost/35343-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@772c7e0 rejected from java.util.concurrent.ThreadPoolExecutor@69317f18[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 531] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 17:56:32,822 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38881,1676310818035] 2023-02-13 17:56:32,823 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38881,1676310818035; numProcessing=1 2023-02-13 17:56:32,824 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38881,1676310818035 already deleted, retry=false 2023-02-13 17:56:32,824 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,38881,1676310818035 expired; onlineServers=0 2023-02-13 17:56:32,824 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,41433,1676310816814' ***** 2023-02-13 17:56:32,824 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-13 17:56:32,824 DEBUG [M:0;jenkins-hbase4:41433] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6067dac5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 17:56:32,824 INFO [M:0;jenkins-hbase4:41433] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,41433,1676310816814 2023-02-13 17:56:32,824 INFO [M:0;jenkins-hbase4:41433] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,41433,1676310816814; all regions closed. 2023-02-13 17:56:32,824 DEBUG [M:0;jenkins-hbase4:41433] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 17:56:32,824 DEBUG [M:0;jenkins-hbase4:41433] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-13 17:56:32,825 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-13 17:56:32,825 DEBUG [M:0;jenkins-hbase4:41433] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-13 17:56:32,825 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676310819196] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676310819196,5,FailOnTimeoutGroup] 2023-02-13 17:56:32,825 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676310819192] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676310819192,5,FailOnTimeoutGroup] 2023-02-13 17:56:32,825 INFO [M:0;jenkins-hbase4:41433] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-13 17:56:32,825 INFO [M:0;jenkins-hbase4:41433] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-13 17:56:32,825 INFO [M:0;jenkins-hbase4:41433] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-13 17:56:32,825 DEBUG [M:0;jenkins-hbase4:41433] master.HMaster(1502): Stopping service threads 2023-02-13 17:56:32,825 INFO [M:0;jenkins-hbase4:41433] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-13 17:56:32,826 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-13 17:56:32,826 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 17:56:32,826 ERROR [M:0;jenkins-hbase4:41433] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-20,5,PEWorkerGroup] Thread[HFileArchiver-21,5,PEWorkerGroup] Thread[HFileArchiver-22,5,PEWorkerGroup] 2023-02-13 17:56:32,826 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 17:56:32,826 INFO [M:0;jenkins-hbase4:41433] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-13 17:56:32,826 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-13 17:56:32,827 DEBUG [M:0;jenkins-hbase4:41433] zookeeper.ZKUtil(398): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-13 17:56:32,827 WARN [M:0;jenkins-hbase4:41433] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-13 17:56:32,827 INFO [M:0;jenkins-hbase4:41433] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-13 17:56:32,827 INFO [M:0;jenkins-hbase4:41433] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-13 17:56:32,827 DEBUG [M:0;jenkins-hbase4:41433] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 17:56:32,827 INFO [M:0;jenkins-hbase4:41433] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 17:56:32,827 DEBUG [M:0;jenkins-hbase4:41433] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 17:56:32,827 DEBUG [M:0;jenkins-hbase4:41433] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 17:56:32,827 DEBUG [M:0;jenkins-hbase4:41433] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 17:56:32,827 INFO [M:0;jenkins-hbase4:41433] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=512.79 KB heapSize=598.59 KB 2023-02-13 17:56:32,922 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 17:56:32,922 INFO [RS:0;jenkins-hbase4:38881] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,38881,1676310818035; zookeeper connection closed. 2023-02-13 17:56:32,922 ERROR [Listener at localhost/35343-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7f7e719c rejected from java.util.concurrent.ThreadPoolExecutor@69317f18[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 531] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 17:56:32,922 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x1004ed10ea40001, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 17:56:32,923 ERROR [Listener at localhost/35343-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5d4090b1 rejected from java.util.concurrent.ThreadPoolExecutor@69317f18[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 531] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 17:56:32,923 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@a7df766] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@a7df766 2023-02-13 17:56:32,923 INFO [Listener at localhost/35343] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-02-13 17:56:33,236 INFO [M:0;jenkins-hbase4:41433] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=512.79 KB at sequenceid=1006 (bloomFilter=true), to=hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/e0cb1e871fff4ea8969a429910b17b56 2023-02-13 17:56:33,239 INFO [M:0;jenkins-hbase4:41433] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e0cb1e871fff4ea8969a429910b17b56 2023-02-13 17:56:33,240 DEBUG [M:0;jenkins-hbase4:41433] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/e0cb1e871fff4ea8969a429910b17b56 as hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/e0cb1e871fff4ea8969a429910b17b56 2023-02-13 17:56:33,243 INFO [M:0;jenkins-hbase4:41433] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e0cb1e871fff4ea8969a429910b17b56 2023-02-13 17:56:33,243 INFO [M:0;jenkins-hbase4:41433] regionserver.HStore(1080): Added hdfs://localhost:46797/user/jenkins/test-data/8731ace6-c9b1-fee4-45be-5ce4ce41712a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/e0cb1e871fff4ea8969a429910b17b56, entries=123, sequenceid=1006, filesize=33.3 K 2023-02-13 17:56:33,243 INFO [M:0;jenkins-hbase4:41433] regionserver.HRegion(2947): Finished flush of dataSize ~512.79 KB/525094, heapSize ~598.57 KB/612936, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 416ms, sequenceid=1006, compaction requested=false 2023-02-13 17:56:33,244 INFO [M:0;jenkins-hbase4:41433] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 17:56:33,244 DEBUG [M:0;jenkins-hbase4:41433] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676310992827Disabling compacts and flushes for region at 1676310992827Disabling writes for close at 1676310992827Obtaining lock to block concurrent updates at 1676310992827Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676310992827Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=525094, getHeapSize=612936, getOffHeapSize=0, getCellsCount=1161 at 1676310992827Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676310992828 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676310992828Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676310992831 (+3 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676310992831Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676310993240 (+409 ms)Finished flush of dataSize ~512.79 KB/525094, heapSize ~598.57 KB/612936, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 416ms, sequenceid=1006, compaction requested=false at 1676310993243 (+3 ms)Writing region close event to WAL at 1676310993244 (+1 ms)Closed at 1676310993244 2023-02-13 17:56:33,246 INFO [M:0;jenkins-hbase4:41433] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-13 17:56:33,246 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 17:56:33,247 INFO [M:0;jenkins-hbase4:41433] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41433 2023-02-13 17:56:33,250 DEBUG [M:0;jenkins-hbase4:41433] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,41433,1676310816814 already deleted, retry=false 2023-02-13 17:56:33,351 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 17:56:33,351 INFO [M:0;jenkins-hbase4:41433] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,41433,1676310816814; zookeeper connection closed. 2023-02-13 17:56:33,352 ERROR [Listener at localhost/35343-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6597613d rejected from java.util.concurrent.ThreadPoolExecutor@2eaed869[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 907] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 17:56:33,352 DEBUG [Listener at localhost/35343-EventThread] zookeeper.ZKWatcher(600): master:41433-0x1004ed10ea40000, quorum=127.0.0.1:64825, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 17:56:33,352 ERROR [Listener at localhost/35343-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@33dfb043 rejected from java.util.concurrent.ThreadPoolExecutor@2eaed869[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 907] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 17:56:33,354 WARN [Listener at localhost/35343] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 17:56:33,357 INFO [Listener at localhost/35343] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 17:56:33,466 WARN [BP-1376670031-172.31.14.131-1676310813462 heartbeating to localhost/127.0.0.1:46797] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 17:56:33,466 WARN [BP-1376670031-172.31.14.131-1676310813462 heartbeating to localhost/127.0.0.1:46797] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1376670031-172.31.14.131-1676310813462 (Datanode Uuid 2768a823-4a2c-4b8d-8d66-2b14d6ba50bf) service to localhost/127.0.0.1:46797 2023-02-13 17:56:33,469 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b2e1a147-a5e4-cd2d-85aa-2dcb3ac8be25/cluster_42c07e65-ff5f-a75e-a69f-8f3d2a010de7/dfs/data/data1/current/BP-1376670031-172.31.14.131-1676310813462] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 17:56:33,469 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b2e1a147-a5e4-cd2d-85aa-2dcb3ac8be25/cluster_42c07e65-ff5f-a75e-a69f-8f3d2a010de7/dfs/data/data2/current/BP-1376670031-172.31.14.131-1676310813462] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 17:56:33,498 INFO [Listener at localhost/35343] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 17:56:33,629 INFO [Listener at localhost/35343] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-13 17:56:33,728 INFO [Listener at localhost/35343] hbase.HBaseTestingUtility(1293): Minicluster is down